User-specific features for an upgradeable media kernel and engine

ABSTRACT

An audio/video (A/V) system includes an audio/video (A/V) component configured to generate audio or video data. The A/V system includes one or more processing devices, and one or more storage devices storing instructions that, when executed by the one or more processing devices, cause the one or more processing devices to implement one or more audio or video processing applications for the A/V system. Each of the applications can include a processing module and data for a graphical user interface (GUI) for presentation on the A/V system. The applications can be configured to adjust a performance or a setting of the A/V equipment. The A/V system includes an audio or video processing engine configured to interact with the processing modules for the applications, where the audio or video processing engine is configured to share processing resources among two or more of the processing modules.

CROSS REFERENCE TO RELATED APPLICATIONS

This utility application claims the benefit of priority to a U.S.Provisional Application for U.S. Patent Application Ser. No. 61/218,759,titled “UPGRADABLE ENGINE FRAMEWORK FOR AUDIO AND VIDEO,” filed on Jun.19, 2009, the contents of which are incorporated by reference in theirentirety.

TECHNICAL FIELD

This disclosure relates generally to audio and video technology.

BACKGROUND

Video displays, such as CRTs, LCDs, plasma displays, and projectors maybe manufactured and shipped with technology for processing video andhandling audio. In a home theater environment, video displays may beaccompanied by other components. Some components can include videoplayback devices, such as disc players (hard drive disc players, Blu-raydisc players). Home theater systems also can include a variety of typesof speakers, such as compact speakers (e.g., bookshelf speakers) orfloor-standing speakers (e.g., tower speakers, full-range speakers).Other components may include audio-video receivers, which receive asignal (e.g., from the a disc player) and sends it to the speakersand/or the video display.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 depicts a diagram of an example of a home theater system with anupgradeable audio and/or video processing engine.

FIG. 2 depicts a diagram of an example of a graphical user interface(GUI) for selecting and controlling audio and/or video processingapplications that run on the audio and/or video processing engine.

FIG. 3 depicts a diagram of an example of a graphical user interface forobtaining applications that run on the audio and/or video processingupgradeable engine.

FIG. 4A depicts an example of a selection of an application to downloadfrom a graphical user interface (GUI).

FIG. 4B depicts an example of a confirmation of a purchase and downloadof an application.

FIG. 4C depicts a graphical user interface for notifying an A/V userthat their A/V electronic equipment can be upgraded with newapplications.

FIG. 5 depicts a diagram of an example of the upgradable audio and/orvideo processing engine and processing modules and implementingparticular processing applications.

FIG. 6 depicts a diagram with an example of running processes withoutthe upgradable engine.

FIG. 7 depicts a diagram with an example of running processes with theupgradable engine.

FIG. 8 depicts a diagram with an example of the processing requirementsfor a number of applications with and without the upgradable engine.

FIG. 9 depict examples of process requirements with and without theupgradable engine.

FIG. 10 depicts an example of a system that includes an upgradableengine that is integrated with an audio decoder.

FIG. 11 depicts an example of a system that includes an upgradableengine that is integrated with a video decoder.

FIG. 12 depicts an example of an engine framework.

FIG. 13 depicts an example of a system that includes two differentprocessing chains.

FIG. 14 depicts an example of factors used to determine a processingorder.

FIG. 15 depicts an example of a flow diagram for a process fordetermining a processing order.

FIG. 16 depicts an example of a flow diagram for a process fordetermining a processing order.

FIG. 17 depicts an example of a flow diagram of a process for adjustingdevice performance and providing statistics based on device and userfactors.

FIG. 18 depicts an example of a sensory system for an audio engine and avideo engine.

FIG. 19 depicts an example of a flowchart of a process for providingstatistics based on device characteristics and environmental data.

FIG. 20 depicts an example of a diagram showing a relationship among anapplication provider/developer, an A/V equipment manufacturer, and acontent provider.

Like reference numbers and designations in the various drawings canindicate like elements.

DESCRIPTION OF EXAMPLE EMBODIMENTS

Example embodiments relating to upgradable audio and video applicationsare described herein. In the following description, for the purposes ofexplanation, numerous specific details are set forth in order to providea thorough understanding of various embodiments. It will be apparent,however, that these embodiments may be practiced without these specificdetails. In other instances, structures and devices are shown in blockdiagram form in order to avoid unnecessarily obscuring other features.The details of one or more embodiments are set forth in the accompanyingdrawings and the description below. Other features, objects, and aspectsare apparent from the description and drawings, and from the claims.

Overview

Some embodiments of the disclosed techniques involve an audio/video(A/V) system including: an audio/video (A/V) component configured togenerate audio or video data; one or more processing devices configuredto implement: an audio or video processing engine configured to processthe audio or video data to generate one or more different domainrepresentations of the audio or video data; and one or more audio orvideo processing applications that are each configured to access one ormore of the different domain representations of the audio or video dataand to perform audio or video processing on the one or more accesseddomain representations of the audio or video data. Each of the one ormore processing applications access and process the domainrepresentations independently of each other.

These and other embodiments can optionally include one or more of thefollowing features. The one or more processing devices can be configuredto download the one or more applications from a server. The one or moreprocessing devices can be configured to present an interface for a userto select one or more of the applications for downloading. The one ormore processing devices can be configured to present an interface to anA/V user of the A/V component, in which the interface can be configuredto allow the A/V user to control settings for the one or more audio orvideo processing applications. The interface can include one or morepanels for each audio or video processing application. The one or morepanels can allow at least one of following functions: a first panel toactivate or de-active the application; a second panel to provide adescription of the application to the A/V user; and a third panel topresent the settings to the A/V user. Each audio or video processingapplication can include a processing module to interact with the audioor video processing engine, and application data for the interface forpresentation of control and description information for the applicationon the one or more panels. The interface can be overlayed over at leastan image of video content that is playing or playable in a background.The A/V system can include a router coupled to the A/V component. Therouter can include one or more of the processing devices. A computer canbe coupled to the router and the computer can include one or more of theprocessing devices. The A/V component can include one or more of theprocessing devices. The A/V component can include a video display, adigital video player, a television tuner, an audio-video receiver (AVR)system, a satellite receiver, and/or a cable television box. The domainrepresentations can include a frequency domain and a perceptual domain.

In other general aspects, techniques involve a method comprising:executing an audio or video processing engine configured to processaudio or video data to generate one or more different domainrepresentations of the audio or video data; and executing one or moreaudio or video processing applications configured to access one or moreof the different domain representations of the audio or video data andto perform audio or video processing on the one or more accessed domainrepresentations of the audio or video data.

These and other embodiments can optionally include one or more of thefollowing features. The method can include downloading one of the audioor video processing applications from an application developer using auser account, in which each downloadable audio or video processingapplication can include data for a graphical user interface (GUI) forpresentation on an A/V component. The method can include installing thedownloaded audio or video processing application to be used with theengine. The method can include: using the GUI to receive a user input toadjust the performance of the A/V component; and in response to the userinput, adjusting the performance of the A/V component; and presenting arepresentation of the adjustment to the performance of the A/V componentin the GUI. The audio or video processing application can include aprocessing module. The method may involve sharing processing resourceswhen two or more processing modules are processed in a frequency domainwith the engine, and the sharing of processing resources can involve areuse of processes with the engine. The processing in the frequencydomain can involve utilizing one or more transforms comprising a FastFourier Transform (FFT), a hybrid Quadrature Mirror Filter (QMF) bank, adiscrete cosine transform (DCT), a modified discrete cosine transform(MDCT), a Quadrature Mirror Filter (QMF), a pseudo-quadrature mirrorfilter (PQMF), or a modified FFT representation. The processing in thefrequency domain can utilize a frequency domain representation of adecoder. The processing in the frequency domain may utilize afrequency-to-time domain transformation of the decoder. The audio orvideo processing can include: a transformation of the audio or videodata from a time domain to a frequency domain; processing with theengine the transformed audio or video data with the two or more audio orvideo processing applications having processing modules in the frequencydomain; and a transformation of the processed audio or video data fromthe frequency domain to the time domain. At least one of the processingmodules can be configured for processing in the time domain and in thefrequency domain. The method can include adjusting the performance of anA/V component by providing functionality for the A/V component inaddition to the functionality of the A/V component at the time ofmanufacture. The A/V component can include a video display, a digitalvideo player, a television tuner, an audio-video receiver (AVR) system,a satellite receiver, or a cable television box. The method can includeadjusting an A/V component in regards to one or more factors. The one ormore factors can include a setting of the A/V component, a usage historyof the A/V component, a configuration of the A/V component, a resourcesharing requirement for the A/V component, a performance requirement forthe A/V component, an amount of processing resources, a level of qualityof the A/V component, a type of content to be played on the A/V system,and/or a number of processing modules to process.

In other general aspects, techniques involve an audio/video (A/V) systemcomprising: one or more processing devices; and one or more storagedevices storing instructions that, when executed by the one or moreprocessing devices, cause the one or more processing devices toimplement one or more audio or video processing applications for the A/Vsystem. Each of the applications includes a processing module and datafor a graphical user interface (GUI) for presentation on the A/V system.Each application is configured to adjust a performance or a setting ofthe A/V equipment. The system includes an audio or video processingengine configured to interact with the processing modules for theapplications, in which the audio or video processing engine isconfigured to share processing resources among two or more of theprocessing modules.

These and other embodiments can optionally include one or more of thefollowing features. The audio or video processing engine can include anaudio signal analysis (ASA) module for signal analysis of audio or videodata, in which the ASA module can be further configured for sharingprocessing resources among the applications. The A/V system can includemetadata regarding the applications and the upgradable engine. Themetadata can include information regarding statistics associated withthe engine, the applications, a user of the A/V system, characteristicsof the A/V system, and/or characteristics of the user. The engine can beconfigured to manage the metadata. The characteristics of the A/V systemcan include an age, a model, a performance specification, an amount ofusage, a type of content used, a performance setting, an amount ofprocessing resources, an input or output configuration, and/or acompatibility of the A/V equipment of the A/V system. Thecharacteristics of the user can include an age of the user, a habit ofthe user, a number of downloaded applications from the user, a type ofdownloaded applications from the user, and/or data from a profile of theuser based on a user profile or a user account. The upgradable enginecan be configured to use at least one of the applications with themetadata for enhancing a quality of a sound or an image for the A/Vsystem over the quality of the sound or the image when used without theapplication. The GUI can include data or utilize data to present: one ormore buttons for selecting or de-selecting of the application; adescription of a purpose or a function of the application; settings forconfiguring the A/V system; and/or a meter reading to present ameasurement of a unit related to an audio or video quality. The GUI caninclude data and/or utilize data for each application to conform to asimilar layout or design format. The processing modules can share acommon application programming interface (API). Each of the processingmodules for each application can include A/V data, signal analysismodules, functional modules, and/or application programming interface(API) information. The applications can be downloadable applications.The A/V system can include a sound sensor coupled to the A/V system todetect sound conditions around the A/V system, and a light sensorcoupled to the A/V system to detect light conditions around the A/Vsystem. The upgradable engine can be configured to manage downloadedapplications and adjust the performance or the setting of the A/Vequipment based on the light and sound conditions. The A/V system caninclude a user account that includes information for the A/V user, theA/V system, and/or the downloaded and downloadable applications. The GUIcan be configured to manage the information for the user account withthe A/V user and an application developer. The A/V system can beconfigured to send statistics to the application developer over anInternet connection regarding the upgradable engine, the downloadedapplications, the A/V user, characteristics of the A/V system, orcharacteristics of the A/V user. The A/V system can be configured to usedata for the light and sound conditions to download the downloadableapplications and adjust the performance or the setting of the A/Vequipment. The A/V system can include and/or utilize a light and soundprofile for the light and sound conditions of the A/V equipment. Thelight and sound profile can be stored in one of the storage devices. TheA/V system can include and/or utilize a biometric profile of the A/Vuser, in which the A/V system can be configured to further adjust theperformance or the setting of the A/V equipment based on the biometricprofile of the A/V user. The biometric profile of the A/V user caninclude at least a hearing profile of the A/V user.

In other general aspects, a method involves accessing a plurality ofprocessing modules for a plurality of downloadable applications. Eachdownloadable application includes at least one processing module anddata for a graphical user interface (GUI). Each processing module isconfigured to interact with an upgradable engine to adjust a performanceor a setting of an audio and video (A/V) equipment. The method includesarranging an order of two or more of the processing modules in aprocessing chain to share processing resources, to reduce a processingrequirement of the A/V equipment, and/or to enhance a level ofperformance of the A/V equipment.

These and other embodiments can optionally include one or more of thefollowing features. The arranging of the order of the two or moreprocessing modules can involve using metadata to control the processingorder. The metadata can relate to a processing requirement or a level ofperformance. The order of the processing modules can include an order inwhich the processing modules are processed with the upgradable engine,in which the processing order of the processing modules can bedynamically adjustable based on one or more factors. The one or morefactors can include a type, an age, a performance specification, or acondition of the A/V equipment, an input configuration or outputconfiguration on the A/V equipment, an amount of available processingresources, a number of processing modules to process, a type ofprocessing module, user requirements, a level of a quality of the A/Vequipment, a type of content to be played by the A/V equipment, aprocessing module to add to the processing chain, user input,information from a user profile, a usage history of the A/V equipment, apredefined processing order for a processing chain, and/or informationdownloaded from an application developer. Arranging the order of two ormore of the processing modules can be based upon a predefined processingorder for a configuration of the A/V equipment. The predefinedprocessing order can be downloaded from an application developer.Arranging the order of two or more of the processing modules caninclude: assigning each of the processing modules to a level of ahierarchy of a processing chain; for each level of the hierarchy,evaluating a processing cost or a processing resource requirement todetermine if the processing cost or the processing resource requirementis lower if the processing module in that level is rearranged intoanother level of the hierarchy; and if the processing cost or theprocessing resource requirement is lower if the processing module ispositioned in the other level of the hierarchy, then rearranging theorder of the hierarchy to position the processing module in the levelthat produces the lower processing cost.

In other general aspects, an audio/video (A/V) system includesdownloadable applications for an A/V system. Each of the downloadableapplications includes a processing module and data for a graphical userinterface (GUI) for presentation on the A/V system. Each downloadableapplication is configured to adjust a performance or a setting of theA/V equipment. The system includes an upgradable engine configured tointeract with the processing modules for the downloadable applications.The upgradable engine is configured to share processing resources in theA/V system for the processing module. The upgradable engine isconfigured to manage downloaded applications and adjust the performanceor the setting of the A/V equipment based on one or more factors.

These and other embodiments can optionally include one or more of thefollowing features. The A/V system can include and/or utilize a useraccount that comprises information for the A/V user, the A/V system, andthe downloaded and downloadable applications. The GUI can be configuredto manage the information for the user account with the A/V user and anapplication developer. The A/V system can be configured to sendstatistics to the application developer over an Internet connectionregarding the upgradable engine, the downloaded applications, the A/Vuser, characteristics of the A/V system, and/or characteristics of theA/V user. The one or more factors can involve a type of A/V equipment,an input configuration of the A/V equipment, an output configuration ofthe A/V equipment, a specification of the A/V equipment, a level ofquality of the A/V equipment, and/or a usage history of the A/Vequipment. The one or more factors can involve an amount of processingpower available for the A/V system, a number of applications forprocessing, a type of application for processing, or a type ofapplication available for downloading. The one or more factors can alsoinvolve a type of A/V content to be played on the A/V system, a userpreference, or a user input. The one or more factors can include an ageof the A/V equipment or a level of degradation of performance of the A/Vequipment over time. At least one of the applications can be configuredto correct for the level of degradation of performance of the A/Vequipment. The A/V system also can include and/or utilize a biometricprofile of the A/V user. The A/V system can be configured to furtheradjust the performance or the setting of the A/V equipment based on thebiometric profile of the A/V user. The biometric profile of the A/V usercan include a hearing profile of the A/V user.

In other general aspects, techniques involve a method for audio andvideo (A/V) equipment. The method includes sending a processing modulefor at least one of a plurality of downloadable applications from anapplication developer over an Internet connection to A/V equipment foran A/V user. Each downloadable application includes at least oneprocessing module. Each downloadable application can be configured tointeract with an upgradable engine to adjust a performance or a settingof the A/V equipment. The method includes sending statistics from theA/V equipment to the application developer over the Internet connection.The statistics includes information for the upgradable engine, thedownloaded applications, the A/V user, characteristics of the A/Vequipment, and/or characteristics, habits, or demographics of the A/Vuser. The method includes forwarding at least some of those statisticsfrom the application developer to a content provider or a manufacturerof the A/V equipment, and transmitting fee information between theapplication developer and the content provider or between theapplication developer and the manufacturer of the A/V equipment.

These and other embodiments can optionally include one or more of thefollowing features. The method can involve processing the processingmodule with the upgradable engine. The processing can involve sharingprocessing resources for two or more processing modules when the two ormore processing modules are used to interact with the upgradable engine,and adjusting the performance of A/V equipment using the upgradableengine and the processing module. The fee information can involveinformation for making arrangements for sending a fee from theapplication developer to the content provider. The application developercan make arrangements to pay the content provider or the manufacturer ofthe A/V equipment. The method can involve sending an advertisement thatpromotes the applications of the application developer to the A/Vequipment for the A/V user. The advertisement can be configured forpresentation on the A/V equipment. When A/V content is purchased fromthe content provider by the A/V user, the advertisement can be sent withA/V content from the content provider. When sending the processingmodule, the method can involve sending the processing module for atleast one of the plurality of downloadable applications from a firstcomputer associated with the application developer over the Internetconnection to A/V equipment for the A/V user. When sending thestatistics, the method can involve sending the statistics from the A/Vequipment to the first computer associated with the applicationdeveloper over the Internet connection. When forwarding at least some ofthose statistics, the method can involve forwarding at least some ofthose statistics from the first computer associated with the applicationdeveloper to a second computer associated with the content provider or athird computer associated with the manufacturer of the A/V equipment.When transmitting the fee information, the method can involvetransmitting the fee information between the first computer associatedwith the application developer and the second computer associated withthe content provider or between the first computer associated with theapplication developer and the third computer associated with themanufacturer of the A/V equipment. The method can involve the followingprocesses utilizing multiple computers: forwarding information from thesecond computer associated with the content provider to the firstcomputer associated with the application developer regarding a type ofcontent, target audiences for A/V content, or market information;determining at least one processing module from the first computerassociated with the application developer to send to the A/V equipmentfor the A/V user based on the information from the second computerassociated with the content provider; and sending the at least oneprocessing module over the Internet connection from the first computerassociated with the application developer to the A/V equipment for theA/V user based on the information from the second computer associatedwith the content provider. The content provider can associate the A/Vcontent with an advertisement for the downloadable applications andpromote the downloadable applications to the A/V user along with the A/Vcontent that the content provider provides or develops for the A/V user.The method can involve sending the fee information from the firstcomputer associated with the application developer to the third computerassociated with the manufacturer of the A/V equipment. The feeinformation can also include information for making arrangements forsending a fee from the application developer to the manufacturer of theA/V equipment. The method can include the following processes frommultiple computers: forwarding information from the third computerassociated with the manufacturer of the A/V equipment to the firstcomputer associated with the application developer, determining at leastone processing module from the application developer to send to the A/Vequipment for the A/V user based on the information from themanufacturer of the A/V equipment; and sending the at least oneprocessing module over the Internet connection from the first computerassociated with the application developer to the A/V equipment for A/Vuser based on the information from the third computer associated withthe manufacturer of the A/V equipment. The forwarded information caninclude data, specification, and/or statistical information for the A/Vequipment. The method can include sending additional statistics relatedto the A/V user to the first computer associated with the applicationdeveloper over the Internet connection. The statistics can includeand/or related to user biometric information, user ratings, a userprofile, a viewing or listening schedule of the A/V user, and/or a usageof downloaded applications. The method also can include sending A/Vcontent from the second computer associated with the content provider tothe A/V equipment for the A/V user.

Any of the methods and techniques described herein can also beimplemented in a system with one or more components, an apparatus ordevice, a machine, a computer program product, in software, in hardware,or in any combination thereof. For example, the computer program productcan be encoded on a computer-readable medium, and can includeinstructions to cause a data processing apparatus (e.g., a dataprocessor) to perform one or more operations for any of the methodsdescribed herein.

To illustrate how these techniques can be implemented, several exampleembodiments are depicted and described.

System Overview

FIG. 1 depicts a diagram with an example of a home theater system 100with an upgradeable audio and/or video processing engine. The systemincludes audio-visual components, such as a television or video monitor105, one or more media devices 110 (e.g., a DVD player, a digital videorecorder, a digital television (DTV) tuner, or a satellite or cablebox), and audio-video receiver (AVR) system, and one or more channels ofspeakers 140A-140F. These components are coupled using, for example, awired or wireless High-Definition Multimedia Interface (HDMI) or othernetwork 122. A first router 120 is coupled to the network 122 and cancommunicate with a second router 135 over a wired or wireless HDMI,WiFi, or other network 127. The second router 125 is coupled to ageneral or special purpose digital processing system 130, such as adigital signal processing (DSP) system or a general purpose computer.

The computer system 130 implements an upgradeable/extensible audioand/or video processing engine. The audio and/or video processing enginemay be implemented in software, firmware, hardware, or some combinationof software, firmware, or hardware. The audio and/or video processingengine may be designed to perform basic or underlying audio and/or videoprocessing manipulations, which may allow various audio and/or videoprocessing applications to be designed to run on the audio and/or videoprocessing engine and perform particular audio and/or video processingfunctions. For example, a speech clarity processing application may bedesigned to run on the processing engine and process audio informationto improve the clarity of speech in the audio information. One or moreexamples of such an audio and/or video processing engine are describedbelow.

The audio and/or video processing engine and applications implemented oncomputer 130 can process audio and video (“A/V”) information from one ormore of the audiovisual components 105, 110, or 115 to apply the audioand/or video processing functions implemented by the applications to theA/V information. The processed A/V information may then be sent from thecomputer to an appropriate one or the audiovisual components 105, 110,or 115. The unprocessed A/V information may be sent from an audiovisualcomponent 105, 110, or 115 across the routers 120 and 125 to thecomputer system 130, and processed A/V information may be sent from thecomputer system 130 across the routers 120 and 125 to the appropriateaudiovisual component 105, 110, or 115.

The computer system 130 also implements, for example, a web interface132. The web interface 132 may allow a user to access, for example, awebpage from which the user can download and install audio and/or videoprocessing applications to update their home theater system 100. The webinterface 132 also may allow the user to access, for example, a webpageshowing a user account and/or a status of audio and/or video processingapplications that are present on the home theater system 100. Useraccount information may be managed and stored at a computer and/or adatabase provided at an application developer or provider. In someembodiments, the application developer and the application provider maybe the same entity. For example, various audio and/or video processingapplications may be developed, stored, and/or provided by computers anddatabase systems from Dolby Laboratories, Inc. of San Francisco, Calif.The user's account can provide a list of all applications that have beenpurchased and/or applications that are in current use by the user on theuser's system. The user's account may also display new applications thatthe user can download based on the user's system and preferences. Theweb interface 132 may be displayed, for example, on a monitor associatedwith the computer system 130 or on the television or video monitor 105.

A user interface that provides user control of the audio and/or videoprocessing applications running on the audio and/or video processingengine may be displayed on the television or video monitor 105. The userinterface on the television or video monitor 105 can be overlaid over animage from a movie, program, or show that may be playing on thetelevision. For example, the computer system 130 may overlay the userinterface on video information processed by the audio and/or videoprocessing engine and applications. The image may be a still picture ora motion picture. The user interface on the television or video monitor105 may be controlled by a remote control associated with the television105, the media device 110, or the AVR system 115.

The system 100 can include several components for a flexible, upgradableprocessing engine. The system 100 can provide for real-time processingof audio and video over HDMI (or another type of network) withaudio/video consumer electronic equipment. The audio/video equipment mayor may not have applications for the audio and/or video processingengine installed when the audio/video equipment was purchased by theuser. However, the system 100 may allow a user to download and installaudio and video applications for their electronic equipment.

While the audio and/or video processing engine has been described asbeing implemented on the computer system 130, the audio and/or videoprocessing engine may be implemented, either additionally oralternatively, on one or more of the television or video monitor 105,the routers 120, 125, the AVR system 115, or the media device 110.

FIG. 2 depicts a diagram of an example of a graphical user interface(GUI) 200 for controlling or otherwise interacting with the audio and/orvideo processing applications installed to run on the audio and/or videoprocessing engine. The GUI 200 may be displayed, for example, on thetelevision or video monitor 105.

In the GUI 200, an image 205 from a movie, program, or show is playingon the television. The image 205 may be presented as a background image.The GUI 200 may be displayed on top of the image 205, in which the GUI200 may be partially transparent to allow the user to see the contentthat is playing or being displayed. Installed audio and/or videoprocessing applications 210, 220, 230 can be shown on the left-hand sideof the image 205, and a user can select one of the applications, such asthe audio volume leveling application 220 for managing loudnessvariations between different content and audio sources (e.g., Dolby®Volume), to control or otherwise interact with the application. Eachapplication may have data for its own user interface within the GUI 200.For example, a first panel 240 for settings can allow the user toactivate or deactivate the application 220. A second panel 250 canprovide a description of the application to the user. For instance, inthe example shown, the description of the selected application 220explains that “Dolby® Volume improves the listening experience byleveling the volume across channels, programs and content whilepreserving the full listening experience at any volume level.”

A user can use a controller (e.g., a remote control for the televisionor some other component of the system 100) to control the selection ofthe application and the settings for each application. In someembodiments, the controller may be specific to the audio/video enginerunning the software for the GUI 200. The user can explore, activate,and control the various applications that are installed in the systemusing the GUI 200.

A third panel 260 is provided to provide visual feedback to the user toallow the user to visualize the settings or changes. The third panel 260may have charts, graphs, and data for settings that may changeinteractively with changes in the settings or changes in the content ormedia playback. For example, if the audio leveling application 220 isselected and the setting in the first panel 240 is in the “OFF”position, then the third panel 260 can display charts and graphs for theplayback channels with no leveling processing applied. If the setting inthe first panel 240 is placed in the “MEDIUM” position, then the thirdpanel 260 can display charts and graphs for the playback channels withtime and frequency dependent gains being applied to provide an audioleveling function. The playback data presented in the charts and graphsfor the respective speakers may be moving interactively and/or may useanimation whenever the system is playing, such as for an audio and gainadjustment readout for each speaker. For example, the third panel 260 inthe GUI 200 is illustrating the content level and audio gainsadjustments being applied to 5.1 channels. A menu presented for the GUI200 may be presented that is interactive and intuitive for the user.

The GUI 200 may vary from what is shown in FIG. 2. For example, theremay be a GUI that allows a user to display and/or change a status ofseveral applications simultaneously. There may be other GUIs linked tothe main GUI 200 to control other features or submenus. Any of the otherGUIs may also provide real-time interaction and information exchangeswith applications working with the audio and/or video engine.

FIG. 3 depicts a diagram of an example of a graphical user interface(GUI) 300 for obtaining and installing audio and/or video processingapplications for the audio and/or video processing engine. The GUI 300may include, for example, a web browser 302 that retrieves and displaysa web page 304 that allows the user to obtain and download the audioand/or video processing applications. The web page 304 may showapplications with descriptions, such as for Dolby® Volume 310, Dolby®Dialog Clarity 320, Dolby® Pro Logic IIx® 330, Dolby® Virtual Surround340, and Dolby® Headphone 350. Other applications, including non-Dolbyapplications, may be included in the GUI 300. The GUI 300 has indicators315, 325, 335, 355 for each application to specify if the applicationhas been downloaded and enabled on the user's system 100. The GUI 300also has an indicator 345 to notify the user that new applications areavailable for downloading and installing on their system. The system 100can facilitate the deployment of applications to be used with theprocessing engine, and/or can facilitate and encourage users to upgradeto new or uninstalled applications for their audio/video electronicequipment. Each user can have a user account, password (forauthentication), and a history of previously purchased applications, sothe user can assess which applications have been purchased in the past,as well as view a list of new applications and descriptions that theuser has not purchased. The user account may also include informationfor users, habits (e.g., the programs viewed and their A/V settings),and their equipment, such as A/V equipment (e.g., television, DVDplayer, receiver), which can be used to select appropriate applicationsand predetermined conditions for those applications for purchase anddownload.

When A/V electronic equipment is manufactured, it may be shipped fordistribution and use with pre-installed software for running variousaudio and/or video processing applications. For example, a televisionmay be shipped with software for an audio and/or video processingapplication (e.g., Dolby® Surround) and may not be able to upgrade theiraudio/video application or add recent, newly-developed audio/videoapplications. The time from which applications are developed at theapplication developer to the time those applications are released in aproduct for sale in the marketplace can be appreciable. For example, itmay take over a year for a newly developed application to be released ina product. Embodiments relate to providing applications to the user, asin the GUI 300, enabling users to install the latest audio/videoapplications for their electronic equipment without inconvenient delay.Hence, new applications and technologies from the application developercan be released to users, and users may be able to upgrade thefunctionality of their A/V electronic equipment.

FIG. 4A depicts an example of a selection of an application to downloadfrom a graphical user interface (GUI) 475. In the GUI 475, theapplication can be selected from an online store to purchase for aparticular price, added to a checkout cart for the user, and the usercan complete the checkout process and download the application to theirA/V system. Information can also be stored in the user profile for userpurchases, such as the user purchase of the application 477 in FIG. 4A,and the information may be stored with and recalled along with a useraccount to facilitate future purchases of applications. FIG. 4B depictsan example of a confirmation 490 of a purchase and download of theapplication. The confirmation 490 may also include an indication to theuser that the application has also been installed on their A/V system.FIG. 4C depicts a graphical user interface 495 for notifying an A/V userthat their A/V electronic equipment can be upgraded with newapplications. The graphical user interface 495 in FIG. 4C shows a notice497 that the viewer can upgrade the features and performance of theirexisting A/V system with new applications from the applicationdeveloper.

Engine and Applications

FIG. 5 depicts a diagram of an example of a system 500 that includes anupgradeable/extensible audio processing engine 510 with audio processingapplications 540, 545, 550, and 555. The engine 510 may perform basicmanipulations to generate several signal representations that areemployed by the audio processing applications 540, 545, 550, and 555.The signal representations generated by the engine 510 may be those thatare common to many post-processing algorithms and computationally costlyrelative to the other computations used in the post processingalgorithms (for example manipulation of the computed signalrepresentations). The applications 540, 545, 550, and 555 retrieve theappropriate signal representation(s) from the engine 510, modify therepresentation(s) according to the application, and return results backto the engine 510.

In the engine 510, audio is transformed from the time domain to thefrequency domain, to the perceptual domain, back to the frequencydomain, and back to the time domain. In particular, the engine 510includes a forward Fast Fourier Transform (FFT) module 515, a perceptualmodel module 520, an inverse perceptual model module 530, and an inverseFFT module 535. The forward FFT module 515 produces a FFT representationof incoming audio data. In some embodiments, the perceptual model module520 can model human hearing, in which the model can transform audio intoa representation that perceptualizes frequency and/or represents how thebrain perceives sound. The perceptual model module 520 may take intoaccount the nonlinearities and transformations of human hearing andsound, as well as performing scaling and manipulation of the audio data.The inverse perceptual model module 530 undoes the modeling andmanipulations of the perceptual model module 520. The inverse FFT module535 performs an inverse FFT for the results from the inverse perceptualmodel module 530.

The applications interacting with the engine 510 include a volumesmoothing module (e.g., Dolby Volume®) 540, equalization filter module545, Application C 550, and Application D 555. Rather than computing theappropriate signal representations themselves, the applications 540,545, 550, and 555 may instead retrieve the appropriate representationfrom the engine 510. For example, volume smoothing and speech clarityprocess modules may use a perceptual representation, which is derivedfrom an FFT, and an equalization module may use an FFT representation.Rather than each application individually computing the FFT and/orperceptual representation, the applications may access the appropriaterepresentation from the engine 510 and, as a result, the appropriaterepresentation may be computed only once by the engine 510. This mayreduce the computational complexity of the combined processes comparedto the computational complexity if the processes each compute theappropriate representations.

The volume smoothing application 540 addresses volume variations acrossboth program content and program sources while simultaneously provingvibrant audio performance at all playback levels, whether soft or loud.The volume smoothing application 540 can operate on a perceptualrepresentation that is retrieved from between the perceptual modelmodule 520 and the inverse perceptual model module 530 of the engine510. The volume smoothing application 540 can automatically adjust theloudness of an audio signal by modifying the perceptual representationthat is derived from the FFT representation.

The equalization filter application 545 can retrieve from the engine 510an FFT representation, modify the FFT representation to performequalization, and pass back the processed FFT representation to theengine 510 at a point prior to the inverse FFT module 535. The engine510 may interact with other applications in addition to or instead ofthe applications 540, 545, 550, 555 shown in FIG. 5.

The engine 510 may have other modules instead of or in addition to themodules shown in FIG. 5. For example, a module for a hybrid QuadratureMirror Filter (QMF) bank can be used instead of the Forward FFT module515, and module for an inverse hybrid QMF bank can be used instead ofthe inverse FFT module 535. Also, there may be some processes that maybe processed in the time domain, and other processes that may beprocessed in the frequency domain. The number and type of processmodules may be dynamically added to or removed from the engine 510 basedon the requirements for the processing resources of the system.

Other applications that can be used with the engine may include, forexample, up-mixing, virtual sound, dialog enhancement, content-adaptiveequalization, and acoustic environment compensation. In someembodiments, the applications can reuse much of the software from theengine through a standard application programming interface (API), andthe effort to port an application may only involve the software thatmodifies the engine. New applications can be developed and sent toexisting consumer electronic products instead of only being availablefor electronic products during the manufacturing stage of the electronicproduct cycle. As a result, a time for the new applications to reach themarketplace can be reduced since these applications can be brought tothe market shortly after their development.

FIG. 6 depicts example computational costs, which may be associated withrunning three processing modules independently and without the engine.For example, the example computational costs may represent those thatmay typify three example application processing modules: (1) a firstapplication 610 for rendering a 5.1 (or more) channel home theater audiopresentation; (2) a second application 630 for creating a surround soundexperience from any stereo, two-channel movie, music, TV, or game audiosource; and (3) a third application 620 that delivers a surround soundexperience from any pair of stereo speakers, such as speakers for smallrooms, home offices, or bedrooms, e.g., where more than a simple orinexpensive speaker system may not be practical.

For example, the computational costs for the pie chart 600 may relate toa representation of a two-channel playback system, in which stereocontent can be up-mixed to 5.1 channels (i.e., 6 channels) using theprocesses related to the second application 630 for creating a surroundsound experience from any stereo, two-channel movie, music, TV, or gameaudio source (e.g., Dolby® Pro Logic II™). The computational costs arelargest for the processing module for the first application 610 when theengine is not used.

Embodiments use the engine to enable the computing resources of theprocesses to overlap, share resources, and/or share information. Forexample, an embodiment functions to level the six channels with theprocessing module for the surround-sound application, and uses theprocessing module for the application that delivers a surround soundexperience from any pair of stereo speakers to effectuate virtualsurround sound.

FIG. 7 depicts a diagram with an example of running processes forvarious applications with the upgradable engine. In particular, FIG. 7shows a pie chart 700 with the computational costs of running threeprocessing modules for various applications with the engine. For theseapplications, the computational costs are shown for a processing modulefor 5.1 channels for a first application 750 (e.g., Dolby® Volume), aprocessing module for a second application 730 (e.g., Dolby® Pro LogicII™), a processing module for a third application 740 (e.g., Dolby®Virtual Speaker), the engine 710, and the computational savings 720 whencompared to not using the engine 710. Embodiments use the engine, whichshares processing resources and thus reduces computational costs andcomplexity. In this example, the computational costs of the processesfor the first application 750, the second application 730, and the thirdapplication 740 are all less than the computational costs of theseprocesses without the engine, as shown in FIG. 6. The computationalsavings 720 shown in FIG. 7 is 33%. In some embodiments, the relativesavings from using the engine can increase as more modules are used withthe engine 710.

FIG. 8 depicts a diagram with an example of the processing requirementsfor a number of applications with and without the upgradable engine. Inparticular, a chart 800 is shown with an example that graphs thecomputation requirements 820 for a number of applications 810. Withoutthe engine 815, the computation requirements 820 increase linearly asthe number of applications increases. With the engine 825, resources formultiple processing modules are shared and the computation requirementsincrease less than when compared to without the engine 815. In someembodiments, the computation requirements may vary from what is shown inthe chart 800. For example, the computation requirements 820 without theengine 815 may not increase linearly, as in FIG. 8. In FIG. 8, thecomputation requirements 820 with the engine 825 may only slightlyincrease after a certain number of applications are utilized. In thoseexamples, the computation requirements with the engine 815 are less thanthe computation requirements without the engine 825.

FIG. 9 depicts examples of process requirements with and without theupgradable engine. The embodiments 900, 950 may involve examples of A/Vsystem configurations for when a user may want to upgrade their existingaudio electronic equipment to have better sound and audio clarity. Theapplications in the embodiment 900 that do not share resources with theengine have processing modules for Dolby® Pro Logic II 920, TimeEqualization Control 925, Dolby® Volume 930, and Dialog Clarity 935. Theprocessing modules for Dolby® Pro Logic II 920 and Time EqualizationControl 925 are in the time domain 905, and the processing module forDialog Clarity 935 is in the frequency domain 910. In this embodiment900, the processing module for Dolby® Volume 930 can receive data in thetime domain 905 and send data in the frequency domain 910. Theprocessing requirements for the module for Dolby® Pro Logic II 920 is 25Million instructions per second (MIPS), the module for Time EqualizationControl 925 is 20 MIPS, the module for Dolby® Volume 930 is 60 MIPS, andthe module for Dialog Clarity 935 is 30 MIPS. When summed, the totalprocessing requirements for the embodiment 900 is 135 MIPS.

The applications in the embodiment 950 that shares resources with theengine have processing modules for Dolby® Pro Logic II 965, TimeEqualization Control 970, Dolby® Volume 975, and Dialog Clarity 980. Inthis embodiment 950, the processing module for Dolby® Pro Logic II 965can receive data in the time domain 955 and send data in the frequencydomain 960. The processing modules for Time Equalization Control 970,Dolby® Volume 975, and Dialog Clarity 980 are in the frequency domain960. The processing requirement for the module for Dolby® Pro Logic II965 is 10-15 MIPS, the module for Time Equalization Control 970 is 5MIPS, the module for Dolby® Volume 975 is 30 MIPS, and the module forDynamic Equalization 980 is approximately 0-10 MIPS. The totalprocessing requirements for the embodiment 950 is 45 MIPS to 60 MIPS,which may represent as much as a two-thirds savings in processingrequirements in relation to embodiment 900. The processing modules andthe corresponding processing requirements in FIG. 9 are shown as anexample of the savings in processing requirements by sharing resourcesand using the engine. The processing requirements, processes, and/orprocessing savings may differ from what is shown in FIG. 9.

FIG. 10 depicts an example of a system 1000 that includes an upgradableengine 1030 that is integrated with a low-bit rate audio decoder 1010,such as in advanced audio coding (AAC) or high-efficiency advanced audiocoding (HE-AAC). Decoders can have their own internal frequency domainrepresentations, and those representations can be compatible with postprocessing modules. FIG. 10 shows an audio decoder 1010 that includes afirst audio partial decoder 1005 that converts low-bit rate compressedaudio data from the compressed audio bit-stream domain to the frequencydomain, an engine 1030 with applications (application A 1040,application B 1045, application C 1050), and a second low-bit rate audiodecoder component 1025 that converts data from the frequency domain tothe time domain for the processed audio data. The engine 1030 includes aperceptual model module 1015 and an inverse perceptual model module1020, and the engine 1030 interacts with the processing modules 1040,1045, 1050.

Part of the computational cost of the processing of the engine mayinvolve the transforming time domain related data to the frequencydomain and vice versa. In engine 510 (FIG. 5), the frequency domainrepresentation can be provided by an FFT (and with an inverse operation,returned to the time domain). In FIG. 10, the engine 1030 is modified touse other frequency domain representations, such as those of audiocoders. In FIG. 10 the forward FFT module 515 and the inverse FFT module535 of FIG. 5 are not included because the representations from thosemodules are replaced by the decoder's frequency representation. Forexample, the engine 1030 can use a modified discrete cosine transform(MDCT), as used by some of the post processing modules, as well as apseudo-quadrature minor filter (PQMF), as used by high-efficiencyadvanced audio coding (HE-AAC) techniques. By directly utilizing thefrequency domain representation of an audio decoder and the decoder'scorresponding frequency-to-time transformation, the total computationalcost when the using engine may be reduced.

In some embodiments, the decoder for audio can have a first decodingmodule that can take the encoded bitstream, and then create a frequencyrepresentation of the signal. The engine can then pass the processedfrequency representation data to the component of the decoder that fullytranslates the frequency domain audio data to the time domain forplayback and reproduction over speakers or headphones.

FIG. 11 depicts an example of a system 1100 that includes an upgradableengine 1115 that is integrated with a video decoder 1110. FIG. 11 showsa video decoder 1110 that includes a first video coder 1125 thatconverts video data 1105 from the time domain to the frequency domain,the engine 1115, which interacts with applications (application A 1145,application B 1150, application C 1155), and a second video coder 1135that converts data from the frequency domain to the time domain tooutput processed video data 1107. The engine 1115 includes a perceptualmodel 1120 and an inverse perceptual model 1130, and the engine 1115interacts with the applications 1145, 1150, 1155.

In some embodiments, the upgradable engine can be used with a videodecoder and an audio coder. In some embodiments, the video data may beused with the engine for processing, and may be transported in video bysending data in between video frames. The type of frames may alsodetermine if data is sent in between video frames.

Engine Framework

FIG. 12 depicts an example of an engine framework 1210. The engineframework includes an executive engine for metadata 1230, audio and/orvideo processing applications (e.g., Application A 1215, Application B1245, Application C 1235, and Application D 1240), and an audio signalanalysis (ASA) module 1250.

The engine framework 1210 can generate and maintain information andstatistics regarding installed and/or used applications for A/Velectronic equipment, as well as information and statistics for theusers of the A/V electronic equipment. The engine framework 1210 mayalso receive and notify users of updates to their A/V electronicequipment and provide for improved performance. The engine framework1210 can assess the data or fingerprints of audio (or video) data toidentify the contents of the audio (or video) data, and use thisinformation to improve the sound (or image). For example, the audio maybe from an old recording (or the video can be from an old movie), andthe engine framework 1210 can know which applications to use or installto improve the sound (or picture quality).

The executive engine for metadata 1230 coordinates various metadata usedin the engine framework 1210. The metadata may provide informationregarding the audiovisual components in a home theatre. For example, theuser's A/V system may be a five-year-old plasma TV manufactured by afirst electronic equipment manufacturer, connected with a three-year-oldA/V receiver by a second electronic equipment manufacturer, asix-month-old DVD player by a third electronic equipment manufacturer, aone-year old video game system for a fourth electronic equipmentmanufacturer, and a two-year old set of speakers by a fifth electronicequipment manufacturer. The metadata may include information regardingthe characteristics of these components (e.g., their age, how thecomponents' operation varies with age, their model, their performancespecifications, their compatibility with other electronic equipment)set-up and operation of these components, as well as usage informationabout these components (e.g., how often they are used).

The metadata also may include information regarding the audio and/orvideo processing applications, such as, for example, customizablepresets for the applications that depend on the specific componentsemployed, their age, and/or the environment in which the components areemployed or other factors. For example, some processing modules mayaccept two channels of audio data and create a 5.1 or larger number ofchannels. This type of module can be positioned first in line if theinput is mono or stereo content and subsequent processing modulesrequire multichannel audio input for processing, such as a surroundvirtualizer.

In some embodiments, some modules may create additional audio data withinformation about the content that can be used by other processingmodules. This type of processing module should be placed at or near thefront of the processing chain. For example, one processing module mayextract the voice/dialog content from stereo inputs and create a threechannel output (e.g., left, L, right, R and center, C (voice)), whichcould be useful to a downstream another component, such as a Dolby®Dialog Clarity component.

In some embodiments, the metadata also may include information regardingthe user (e.g., biometric information, such as hearing and or visionloss), the environment in which the components are employed (e.g., soundor light properties of the environment), and/or information regardingthe type of audio or video content, such as audio content from a CD or aDVD, and the nature and/or type of the content, such as music, movie,dialog, sports, indoor activities, or outdoor activities.

As described further below, the executive engine 1230 may coordinate andemploy the metadata to control aspects of the installed applications,such as which applications are installed, their processing order, and ortheir settings. The executive engine 1230 may control the aspects of theapplications, for example, to provide perceptually better audiovisualreproduction of content, to provide processing within the availableresources, or to minimize the processing resources required.

In some embodiments, the metadata may be used in a boot-timeconfiguration when the engine is first used and the system is activated,or in other embodiments, a run-time configuration and used whenever theengine is operating. The metadata may be in a number of formats, such asa binary data stream, an Extensible Markup Language (XML) file,encapsulated digital information. The metadata may be residing in theengine framework 1210, derived from another source over a networkconnection (e.g., metadata from the application developer), attachedwith the audio content, or generated as the system configuration or userprofile is developed.

The Auditory Scene Analysis (ASA) module 1250 can be used for detailedsignal analysis of the audio data. Auditory Scene Analysis can refer toa specific type of audio signal analysis that identifies perceptuallyrelevant elements of the audio that, when known, can result insignificantly higher quality audio post-processing. For example, the ASAmodule inherent in Dolby® Volume may identify those elements of theaudio for which level changes are inappropriate, such as sustainedmusical notes with decays. This is one example of many various auditoryscene elements that can be detected and used to provide high qualitypost-processing. The ASA module 1250 can perform audio analysis andprovide information about the audio signal that may be utilized by anumber of applications, and also can be used as a shared resourcebetween various applications, similar to the signal representations inFIG. 9. In some embodiments, the ASA module 1250 may have features thatdiffer from the processing features of the applications 1215, 1235,1240, 1245, such as complex signal analysis.

Each of the applications may have separate functionality for a graphicaluser interface (GUI) and the underlying processing modules for thatapplication, which implement the audio and/or video processing for thatapplication. For example, Application A 1215 has a GUI 1220 to representthe application on a TV monitor in real-time, and also has a processingmodule 1225 for the engine framework 1210. The GUI 1220 may be shown inthe TV monitor and may have buttons 1255 for a user to select ordeselect features of the application 1215, descriptions 1260 to the userto explain the purpose and function of the application 1215, settings1265 that may be configured for particular electronic equipment andusers, and meter readings 1270 to show a measurement related to an audioor video quality. In some embodiments, the GUI 1220 for the applicationcan be common to the overall GUI 200 for the system framework, as inFIG. 2. In this aspect, the GUI 1220 for an application may have adesign and layout that is similar the GUI of other applications, inwhich buttons and descriptions may have a similar layout. In otherapplications, the format and layout of the meter readings may vary, suchas the meter readings for volume, frequency response, power, noise, peakresponses, average volume level, and other readings for one or moreaudio channels.

The processing module 1225 for the application 1215 may include data1280, signal analysis 1275, internal functional modules 1285, and APIinformation 1290. The data 1280 may include audio data and metadata, aswell as data for the settings 1265, the meter readings 1270, equipmentand application usage information, user data, and data for manufacturerspecifications of the electronic equipment. The processing module 1225can use its own internal functional modules 1285, such as an applicationhaving a first functional module for audio for film, a second functionalmodule for audio for broadcast television, a third functional module forDVDs, and other functional modules for other types of audio. Because theprocesses can reuse much of the software and algorithms from the engineframework 1210 through a standard API, each processing module 1225 mayhave API information 1290 for its application 1215. In some embodiments,the ASA 1250 in the engine may perform the signal analysis, and in otherembodiments, the processing module 1225 for the application 1215 canperform the signal analysis.

Processing Order

In some embodiments, the processing order (e.g., the order of processingmodules in a chain) can be important for proper overall systemperformance, and for the reduction of system resources and memory.Downloadable metadata can help to control the hierarchy and processingorder of the engine and/or its applications/processing modules. In someembodiments, the downloaded applications may also use security featureswhen they are downloaded, such as handshaking, encryption, verification,and authentication.

FIG. 13 depicts an example of a system 1300 that includes two differentprocessing chains 1310 and 1320. An order of dynamic processing or chainmay refer to an order for at least two processing modules that can bearranged and/or changed by the user, the engine, or some application toenhance performance and/or reduce processing and/or memory requirements.In the first processing chain 1310, in which a two-channel speakersystem that has an adequate amount of processing resources for a hometheater system is upgraded to a virtual 5.1 channel speaker system, theprocessing module for process module A 1330 (e.g., such as for Dolby®Pro Logic IIx) can proceed a processing module for process module B(e.g., such as for Dolby® Volume 1340) in the processing chain 1310. Theprocessing module for process module A 1330 can provide a surround soundexperience from any stereo (two-channel), 5.1, or 6.1 channel movie,music, TV, or game audio source and expand the audio up to 7.1 channelsof realistic, natural surround sound. After the processing module forprocess module A 1330 is used in the processing chain 1330, theprocessing module for process module B 1340 can address any volumevariations in the 5.1 channel configuration.

In a second processing chain 1320, a system may have more limitedresources for its A/V configuration and/or processing resources, such asa small TV or laptop computer. In the second processing chain 1320, thesystem may only have the ability to have a maximum of two inputs andoutput channels for the speakers with a limited audio range. For thisembodiment, the processing module for process module B 1350 (e.g., suchas for Dolby® Volume) can proceed the processing module for processmodule A 1360 (e.g., such as for Dolby® Pro Logic II) so that theprocessing module for process module B 1350 can address volumevariations before the processing module for process module A 1360provides (a virtualized) surround sound for the two channels ofspeakers. In some embodiments, the processing order can have a highernumber of processing modules than are shown in FIG. 13, and the type andorder of those processing modules can vary and/or depend on a number offactors.

FIG. 14 depicts an example of factors 1400 used to determine aprocessing order. The processing order can depend on a number offactors, such as a type, age, specification, and/or condition of atelevision or video monitor 1420 or other components, the systemconfiguration 1450 (e.g., a laptop, television, audio system, hometheater system), a number of applications to process 1430, a type ofapplication to process 1460, and/or user requirements and specifications1470. The processing order also can be dynamic in that it can depend onan amount of available processing power 1440, available system resources(e.g., amount of processing capability or memory), a level of quality orperformance of the system (e.g., a small office audio system or a largemulti-channel audio system), or an output configuration (e.g., a numberof speakers, a type of speakers, a number of active speakers, or theconnections between the A/V electronic equipment). In some embodiments,the processing order can be dynamic based on the type of content and theprocessing required. For example, a dynamic reordering of the modulesmay be triggered based on whether the input audio is stereo ormulti-channel audio. Also, if the type of content changes (e.g., frommusic to news) some additional processing modules may be inserted whileothers processing modules may be removed. For example, for news contenta processing module that provides voice clarity may be added, while thatvoice-enhancement processing module may not likely be used for musiccontent.

The processing order for processing modules of applications can also bedetermined by downloadable metadata (1480). Downloadable metadata caninclude information pertaining to newly-released algorithms, which mayrequire different processing orders than previously used. For example, anew algorithm C may operate best between previous algorithms A and B,which were previously ordered one after the other. The metadata can haveinformation to arrange the processing order for the processing modulesof applications. The processing order may also depend on the type ofcontent (e.g., DVD, radio, TV, CD, MP3), and the type of audio (e.g.,voice, music, television audio, movie audio).

The processing order also can be configured dynamically in that newprocessing modules for new applications can be added to any point in aprocessing chain. For example, a new processing module can be addedbetween the processing module for Dolby® Pro Logic IIx 1330 and theprocessing module for Dolby® Volume 1340 in the processing chain 1310 ofFIG. 13. The user may also have the option to determine or change theprocessing order based on user input with a GUI.

In some embodiments, there can be a hierarchy for particular systemconfigurations that can provide for the sharing of processing resources.The hierarchy can have levels based on an amount of processing modulesin the processing chain and/or the types of processing modules in theprocessing chain, where each level may require a certain amount ofprocessing resources. In some embodiments, the hierarchy may representthe allowable chain of processing modules, and the processing order mayrefer to the chain of processing. The allowable chain of processing mayrepresent a chain of processing that is permissible for a particularsystem configuration, in which some processing modules may not be ableto be used in or inserted into particular points in some processingchains. In other embodiments, the hierarchy can represent a preferredprocessing order for a given system configuration. For theseembodiments, for example, the engine can determine a preferredprocessing order based on the type of electronic equipment in the systemand the user preferences. In one example, this determination of thepreferred processing order may be based on communicating informationwith a database over the Internet to the application developer, wherethe application developer can provide a solution for resource sharingbased on a number of factors.

As an example of a hierarchy, the first or second dynamic processingorders 1310, 1320 shown in FIG. 13 may represent a two-level hierarchy(for two processing modules).

FIG. 15 depicts an example of a flow diagram for a process 1500 fordetermining a processing order. The processing order can be determinedbased on a number of factors (1520), as discussed in FIG. 14. At a levelof the hierarchy (1530), a determination can be made if the processingorder needs to be rearranged for the processing module of the hierarchylevel with other hierarchy levels to achieve a certain level of quality,resource sharing, or processing cost (1540). If so, the processing orderof the processing modules in the hierarchy should be rearranged for thathierarchy level (1550), and the processing should be performed based onthe rearranged processing order (1570) with the other hierarchy levels.If the processing order does not need to be rearranged to achieve acertain level of quality, resource sharing, or processing cost (1540),then processing should be performed based on the existing processingorder (1570) and no rearrangements of hierarchy levels need to be made.After the processing is performed (1570) for the processing module ofthat hierarchy level, there is a determination of whether there isanother level of the hierarchy to evaluate for the resources or qualityof the system. If not, then the evaluations of the processing order forthe system terminate. If there is another level of the hierarchy toevaluate, the system goes to that next level of hierarchy (1530) anddetermines if the processing order needs to be rearranged for thathierarchy level and other hierarchy levels to achieve a certain level ofquality or resource sharing (1540).

FIG. 16 depicts an example of a flow diagram for a process 1600 fordetermining a processing order 1600. The processing order may be setbased on a predetermined processing order (1620). The predeterminedprocessing order may be a general initial processing order based on arecommended or a default processing scheme (e.g., a processing order fora 2-channel stereo system that does not have large processing resourcesavailable). In the hierarchal processing order 1600, a level of thehierarchy (1630) is evaluated to determine if the system has theresources for the processing module(s) in the level of the hierarchy(1640). If the resource requirement of the level of the hierarchy cannotbe met (1640), then the processing order of the processing modules isrearranged to lower the processing requirements for that level of thehierarchy (1650). In some embodiments, the rearrangement may lead to are-ordering of existing processing modules in the processing chain. Inother embodiments, the rearrangement may mean substituting differenttypes of processing modules in the processing chain. If the resourcerequirement of the level of the hierarchy can be met (1640), thenprocessing is performed on that level of the hierarchy (1660). If thereis another level of the hierarchy to evaluate (1665), then the systemrepeats similar operations for that level of the hierarchy. Otherwise,the evaluations end if there are no more levels of the hierarchy toevaluate (1670).

Instead of or in addition to determining the processing order based onresources, as in FIG. 16, the processing order can be determined basedon other considerations, such as a quality of audio for a particular A/Vsystem configuration. The processing order may also change if newapplications are to be used and their processing modules need to beinserted into a particular position in the processing chain for bestperformance or quality. In some embodiments, some processing modules canbe processed in parallel in the same level of the hierarchy. Forexample, a first and a second processing module can be processed inparallel a first level of a hierarchy, and a third processing module canbe processed in a second level of the hierarchy.

Device and User Analysis

FIG. 17 depicts an example of a flow diagram of a process 1700 foradjusting device performance and providing statistics based on A/Vequipment and user factors. An analysis using A/V equipment and userparameters is performed (1710) with any number of factors. For example,the age of the A/V equipment may be tracked (1715) to determineperformance and equipment degradation over time, and how additionalapplications can be downloaded to improve performance and/or tocompensate for age-related performance loss. This information may beavailable, for example, from the A/V equipment manufacturer and/or theircustomers (e.g., customer feedback, resells). The type of A/V equipmentalso can be considered in gathering and evaluating data on the modelnumber and performance specifications of the A/V equipment (1720). Thisinformation, for example, may be determined by and gathered from themanufacturer of the A/V equipment.

The configuration of the A/V equipment also may be considered in theanalysis (1725). The configuration may involve how the A/V equipment isconfigured with respect to other A/V equipment in the system. Theconfiguration may also involve having information on the input andoutput configuration, such as a large screen liquid crystal display(LCD) television with five HDMI inputs, 2.1 speakers, two component A/Vport connections, two composite A/V port connections, and three S-videoport connections. The configuration may also involve the physicalaspects of the A/V equipment, such as wall-mountable speakers with athickness of less than five inches and limited audio capabilities.

The usage habits of the A/V equipment may also be a factor (1730). Forexample, if the A/V equipment is an often-used Blu-ray™ disc player,then applications may be downloaded for high quality audio and videoperformance. The characteristics of the user of the A/V equipment alsoare considered in the analysis (1735). For example, a user profile mayprovide information about what type of content the user prefers or thetype of audio set-up the user prefers. For example, the user may have apreference to listen to a particular type of music with a specifiedfrequency response for multiple channels of speakers. The hearing andvisual characteristics of the user may also be considered, such asreceiving information about the hearing capabilities of the user andusing that information to develop an audio profile for the user todownload specific applications to enhance the user's hearing.

After the factors are considered, applications are selected based on thefactors and downloaded to be used with the engine (1745). In addition,the factors can be used to adjust the settings of the downloadedapplications. The applications can be built-into and sold with theoriginal hardware system, and the performance of the A/V electronicequipment can be enhanced based on one or more factors (1750), such asthe factors in FIG. 14. When the applications are integrated, theprocessing chain may be formed or adjusted to provide for resourcesharing and/or improved performance. When the applications aredownloaded (1745), information can also be sent over the Internet to thecontent providers (e.g., music company, movie studio, televisionstation) and/or the A/V equipment manufacturers to allow them to enhancefuture products and services, as well as to develop effective promotionsand advertisements to targeted customer groups (1755).

FIG. 18 depicts an example of a sensory system 1800 for an audio engine1850 and a video engine 1870. In some embodiments, user input andenvironmental conditions can be used to determine applications fordownloading to use with the engines 1850 and 1870 and/or settings forthe applications used with the engines 1850 and 1870. The user input maybe biometric information, and the environmental conditions may be thelight and sound that may be present in the reproduction environment thatcontains the A/V equipment that is being used by the user. In thisembodiment, the A/V equipment detects sound 1830 with an audio sensor1825 that interacts with an audio system 1820. The A/V equipment alsodetects light 1830 with a light sensor 1835 that interacts with a videosystem 1840. The audio system 1820 may be connected with the audiosensor 1825 and the video system 1840 may be connected with the lightsensor 1840 through a wired or wireless connection. The audio system1820 and video system 1840 may have one or more of the components, asshown in the example of FIG. 1.

In some embodiments, the audio sensor 1825 may be located in proximityof the audio system 1820, and the light sensor 1835 may be located inproximity of the video system 1840 so that a user listening to audio orwatching video can experience the added features of the downloadedapplications. In some embodiments, the sensors 1825, 1835 can be locatedin proximity to the A/V equipment user, and the systems 1820, 1840 maynot be located in proximity to the A/V equipment user. For example, thesensors 1825, 1835 may be located near a LCD television and speakers,and some processing equipment for the audio system 1820 and video system1840 may be in another room. The audio engine 1850 and/or video engine1870 may facilitate downloading applications for use.

The audio system 1820 interacts with the audio engine 1850, which usesprocesses for an audio application 1855 and audio settings 1860, such astuner and frequency response settings. The audio application can be, forexample, an application for Dolby® Volume, or some other downloadableaudio application to be used with the audio engine 1850.

The video system 1840 interacts with the video engine 1870, which usesprocesses for a video application 1875 and video settings 1880, such asresolution and video setup settings for the A/V equipment. The videoapplication 1875 can be, for example, an application for somedownloadable video application for the video engine 1870. One videoapplication (e.g., Dolby® Contrast) can be for a video application forimproving the picture quality of LCD televisions by employing LEDbacklighting and other techniques to locally dim backlight areas tomatch the brightness of the image. A second video application, (e.g.,Dolby® Contrast) can enable LCD televisions to display true blacks andlifelike dynamic contrast while consuming less power. A third videoapplication (e.g., Dolby® 3D Digital Cinema) can be for a videoapplication that allows the user to experience a three-dimensionalexperience with sharp, clear images.

In some embodiments, the light sensor 1835 (e.g., a photosensor) can beused to detect whether a room is light or dark (e.g., daytime,nighttime, bright, dim), and that information can be used to adjust thevideo settings, order of the processing chain, and/or type and number ofdownloaded video applications. In other embodiments, the audio sensor1825 can be used to detect sound and noise, and may be used to create anaudio profile for a room, automobile, or airplane. The audio profile maybe used by the downloadable audio applications to improve the sound ofthe A/V equipment and to improve the quality of the sound of the contentgoing to certain audio channels and speakers. In one example, the volumeof certain audio speakers can be adjusted based on the noise in the roomor the sound of people talking in the room. A video profile may also becreated based on the lighting and visual conditions of the viewing area.The audio (or video) profile may be stored in the audio system 1820 (orvideo system 1840), a local personal computer, a memory location (e.g.,memory on a cable TV box), or shared with the application developer, A/Vequipment manufacturer, or content provider.

Applications can also be downloaded based on biometric characteristicsof the user. For example, the A/V equipment user may use their personalcomputer to create a hearing profile that can test and model the hearingabilities of the user. Applications can be downloaded to correct forhearing loss, as well as the loss of hearing at certain frequencies. Theuser may also get their hearing profile from hearing tests performed byan audiologist (e.g., a healthcare professional specializing in theauditory senses). The hearing profile of the user can be stored on amemory device and can be used with the downloadable applications andengine to improve their hearing of sound from the speakers. There can beother profiles with information on the user, such a user profile withthe age of the user and the preferred audio and video content of theuser. Information can be tracked and stored in a user profile on howoften the user uses certain settings, the time of day they use thosesettings, the type of A/V electronic equipment that is used (e.g., a DVDplayer or a video player), the type and usage of the downloadedapplications. Statistics on the user and the user's habits (e.g., howoften an application is invoked) can also be maintained in the userprofile. The user profile can be stored in a database, may be part ofthe engine framework 1210 of FIG. 12, and may be part of a user account.There can be different user profiles for different users of the A/Velectronic equipment.

There can be profiles that include information for the A/V electronicequipment. For example, the A/V electronic equipment may havecustomizable presets based on the type of A/V electronic equipment beingused (e.g., equalization presets for particular types and brands oftelevisions, speakers, etc.), and there can be presets that aredetermined and/or based on the age of the A/V equipment that takes intoaccount how the performance of the A/V equipment degrades over time(e.g., color correcting a plasma television that loses color saturationover time).

FIG. 19 depicts an example of a flowchart of a process 1900 forproviding statistics based on device characteristics and environmentaldata. One or more applications are selected for the A/V equipment(1920). The selection of the application from the application developeror provider may be performed, for example, by the user (using, forexample, the GUI and the Internet, as in FIG. 1, 3, or 19) or theengine. The performance and features of the A/V equipment is transformeddue to the selected applications (1930). The selected applications mayalso transform the A/V electronic equipment in that the A/V electronicequipment can have better or different performance and features thanwhen the A/V electronic equipment was manufactured. Any of the profiles(e.g., user profile, A/V equipment profile, audio and video profiles,etc.) can be uploaded via a network or the Internet and provided to theA/V equipment manufacturers and the content providers to allow them tohave user, usage, and A/V equipment data to modify their future servicesand products, as well as to provide targeted advertisements to potentialcustomers (1940). The A/V equipment manufacturer and content providerscan also receive biometric information, user habits, fees, A/V equipmentcharacteristics, and environmental data (1940).

FIG. 20 depicts an example of a diagram showing a relationship 2000among an application developer 2010, an A/V equipment manufacturer 2020,and a content provider 2030. The application developer may be the entitythat develops the applications. The A/V equipment manufacturer may bethe entity the makes and/or designs the A/V electronic equipment. Theapplication provider may be the entity that provides the application tothe user. The content developer may be the entity that makes the contentto play on the A/V electronic equipment, such as the audio and/or videofor music, movies, television programs, etc. The content provider 2030may be the entity that provides the content to the A/V user for use onthe A/V equipment. In some embodiments, the application developer 2010may be the same entity as the application provider, and the contentprovider 2030 may be the same entity as the content developer. Theapplication developer can send user biometric information and habits,fees, and A/V electronic equipment characteristics, and environmentaldata to the A/V equipment manufacturers 2020 and the content providers.In some embodiments, the application developer can send this informationthrough the use of an embedded application in the A/V electronicequipment. The data from the application developer 2010 can provide theA/V equipment manufacturers 2020 and the content providers 2030 withinformation for a type of rating system for A/V electronic equipment,audience sizes for programming and content, demographics of users ofcertain A/V electronic equipment, and user habits, the content of whatusers listen and watch, statistical information for targeting audiencesand markets, user viewing and listening schedules, and the additionalapplications that users want installed in their existing A/V electronicequipment. In some embodiments, the rating system may be based on thepopularity of the content with one or more other users of the content.The information for the user habits may include the application presetsthat are used by a user, and the types of content that is used by theuser, along with the application presets for certain types of content.Information may also include how often an application is used by a userto determine the popularity of the application in the field of use. Theinformation and data for the user and the A/V electronic equipment mayalso serve for testing new products and services, and may provideinsight that is more refined and dynamic than the results of a usersurvey.

The application developer can receive specific information on productsthat may not be publicly available, such as data regarding theperformance of the A/V electronic equipment over time, and anymalfunctions, recalls, or incompatibilities with other equipment. Also,the content providers can promote the applications of the applicationdeveloper by placing advertisements and promotions with their content(e.g., bundle or tie the software for the upgradeable engine and/orapplications with content, such as movies, television shows, videoclips, or audio content). For example, an advertisement can be displayedbefore a movie on a DVD or Blu-ray™ disc to inform consumers that theycan purchase an application from the application developer for anenhanced viewing or listening experience of the content on their system.For example, the content can be created with enhanced playback enabledby a particular type of application, such as a 3D application for video.

Regarding the fee information, when a customer purchases an application,part of the profits of the purchase can be sent from the applicationdeveloper or provider to the A/V equipment manufacturers and/or thecontent providers/developers. The payment the application developermakes to the A/V equipment manufacturers and the content providers canreward those entities for encouraging the commercialization anddistribution of the software for the upgradeable engine and applicationswith their A/V electronic equipment and A/V content. Fee information andrevenue can also be shared by the application developer with the A/Vequipment manufacturers who host or port the upgradeable engine (andmaybe some applications) from the application developer on their A/Velectronic equipment. For example, the A/V equipment manufacturers canbundle or tie the upgradeable engine with the A/V electronic equipmentwhen the A/V electronic equipment is manufactured or sold.

In some embodiments, the amount of the fee can be based on an actual orestimated number of consumer purchases of applications, and in otherembodiments the fee can be determined based on information and/orstatistics that are shared between the entities. The fee information mayrefer to information related to a monetary exchange, a payment, anobligation or promise to make a payment, a royalty rate or agreement, alicensing arrangement, or a bargained for exchange for a performance byat least one of the entities.

In some embodiments, other consideration can be sent from theapplication developer or provider to the A/V equipment manufacturersand/or the content providers/developers. In some embodiments, thecontent provider/developer can market/advertise the applications of theapplication developer/provider with the content, and the applicationdeveloper/provider can promote and/or market/advertise various types ofcontent from the content provider/developer when the applications areused or being purchased by the user. The advertisements to promote theapplications of the application developer may include graphics, video,and/or audio, and can be played on the A/V equipment of the A/V user. Asdescribed in the example embodiments and systems, the data, statistics,instructions, processing modules, advertisements, A/V content, and/orfee/fee information sent amongst the A/V user, applicationdeveloper/providers, A/V equipment manufacturers, and/or the contentproviders/developers can be transmitted, transformed, and/or processedwith computers and computing systems associated with each of theentities.

Example Systems

The techniques can be used on one or more computers. One or more methods(e.g., algorithms and/or processes) herein can be implemented with, tiedwith, employed on, and/or have data transformed with computers and/orvideo/audio display, transmission, processing apparatuses, and playbacksystems. The computers described herein may be any kind of computer,either general purpose, or some specific purpose computer such as aworkstation. The computer (e.g., 130 in FIG. 1) may be, e.g., an Intelor AMD based computer, running Windows XP™, Vista™, or Linux™, or may bea Macintosh computer. An embodiment may relate to, e.g., a handheldcomputer, such as a PDA, cell phone, or laptop. The computer may alsorefer to machines or parts of a machine for image recording orreception, processing, storage, and distribution of data, in particularvideo or audio data.

Any combination of the embodiments described herein may be part of avideo system and/or audio system and its components. Any combination ofthe embodiments may be implemented in hardware and/or software. Forexample, any of the embodiments may be implemented with a computerprogram. In some instances, the embodiments may be directed to aparticular types of data, such as video data or audio data.

Computer and/or graphic programs may be written in C or Python, or Java,Brew or any other programming language. The programs may be resident ona storage medium, e.g., magnetic or optical, e.g., the computer harddrive, a removable disk or media such as a memory stick or SD media,wired or wireless network based or Bluetooth-based (or other) NetworkAttached Storage (NAS), or other fixed or removable medium. The programsmay also be run over a network, for example, with a server or othermachine sending communications to the local machine, which allows thelocal machine to carry out the operations described herein. The networkmay include a storage area network (SAN).

Although only a few embodiments have been described in detail above,other embodiments are possible. It should be appreciated thatembodiments may encompass equivalents and substitutes for one or more ofthe example techniques described herein. The present specificationdescribes specific examples to accomplish a more general goal in anotherway. This description should be understood to represent exampleembodiments and the claims following are intended to cover anyequivalent, modification or alternative.

Embodiments of the subject matter and the functional operationsdescribed in this specification can be implemented in digital electroniccircuitry, or in computer software, firmware, or hardware, including thestructures disclosed in this specification and their structuralequivalents, or in combinations of one or more of them. Embodiments ofthe subject matter described in this specification can be implemented asone or more computer program products, e.g., one or more modules ofcomputer program instructions encoded on a computer readable medium forexecution by, or to control the operation of, data processing apparatus.The computer readable medium can be a machine-readable storage device, amachine-readable storage substrate, a memory device, or a combination ofone or more of them. The term “data processing apparatus” encompassesall apparatus, devices, and machines for processing data, including byway of example a programmable processor, a computer, or multipleprocessors or computers. The apparatus can include, in addition tohardware, code that creates an execution environment for the computerprogram in question, e.g., code that constitutes processor firmware, aprotocol stack, a graphical system, a database management system, anoperating system, or a combination of one or more of them.

A computer program (also known as a program, software, softwareapplication, script, or code) can be written in any form of programminglanguage, including compiled or interpreted languages, and it can bedeployed in any form, including as a stand alone program or as a module,component, subroutine, or other unit suitable for use in a computingenvironment. A computer program does not necessarily correspond to afile in a file system. A program can be stored in a portion of a filethat holds other programs or data (e.g., one or more scripts stored in amarkup language document), in a single file dedicated to the program inquestion, or in multiple coordinated files (e.g., files that store oneor more modules, sub programs, or portions of code). A computer programcan be deployed to be executed on one computer or on multiple computersthat are located at one site or distributed across multiple sites andinterconnected by a communication network.

The processes and logic flows and figures described and depicted in thisspecification can be performed by one or more programmable processorsexecuting one or more computer programs to perform functions byoperating on input data and generating output. The processes and logicflows can also be performed by, and apparatus can also be implementedas, special purpose logic circuitry, e.g., an FPGA (field programmablegate array) or another programmable logic device (PLD) such as amicrocontroller, or an ASIC (application specific integrated circuit).

Processors suitable for the execution of a computer program include, byway of example, both general and special purpose microprocessors, andany one or more processors of any kind of digital computer. Generally, aprocessor can receive instructions and data from a read only memory or arandom access memory or both. The essential elements of a computer are aprocessor for performing instructions and one or more memory devices forstoring instructions and data. Generally, a computer can also include,or be operatively coupled to receive data from or transfer data to, orboth, one or more mass storage devices for storing data, e.g., magnetic,magneto optical disks, or optical disks. However, a computer need nothave such devices. Moreover, a computer can be embedded in anotherdevice, e.g., a mobile telephone, a personal digital assistant (PDA), amobile audio player, a Global Positioning System (GPS) receiver, to namejust a few. Computer readable media suitable for storing computerprogram instructions and data include all forms of non volatile memory,media and memory devices, including by way of example semiconductormemory devices, e.g., EPROM, EEPROM, and flash memory devices; magneticdisks, e.g., internal hard disks or removable disks; magneto opticaldisks; and discs for CD, DVD, and Blu-ray™ (BD). The processor and thememory can be supplemented by, or incorporated in, special purpose logiccircuitry.

To provide for interaction with a user, some embodiments of the subjectmatter described in this specification can be implemented on a computerhaving a display device, e.g., a CRT (cathode ray tube), LCD (liquidcrystal display), or plasma display monitor, for displaying informationto the user and a keyboard and a selector, e.g., a pointing device, amouse, or a trackball, by which the user can provide input to thecomputer. Other kinds of devices can be used to provide for interactionwith a user as well; for example, feedback provided to the user can beany form of sensory feedback, e.g., visual feedback, auditory feedback,or tactile feedback; and input from the user can be received in anyform, including acoustic, speech, or tactile input.

Some embodiments of the subject matter described in this specificationcan be implemented in a computing system that includes a back endcomponent, e.g., as a data server, or that includes a middlewarecomponent, e.g., an application server, or that includes a front endcomponent, e.g., a client computer having a graphical user interface ora Web browser through which a user can interact with an embodiment ofthe subject matter described is this specification, or any combinationof one or more such back end, middleware, or front end components. Thecomponents of the system can be interconnected by any form or medium ofdigital data communication, e.g., a communication network. Examples ofcommunication networks include a local area network (“LAN”) and a widearea network (“WAN”), e.g., the Internet.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

While this disclosure contains many specifics, these should not beconstrued as limitations or of what may be claimed, but rather asdescriptions of features specific to particular embodiments. Certainfeatures that are described in this specification in the context ofseparate embodiments can also be implemented in combination in a singleembodiment. Conversely, various features that are described in thecontext of a single embodiment can also be implemented in multipleembodiments separately or in any suitable subcombination. Moreover,although features may be described above as acting in certaincombinations and even initially claimed as such, one or more featuresfrom a claimed combination can in some cases be excised from thecombination, and the claimed combination may be directed to asubcombination or variation of a subcombination.

Similarly, while operations are depicted in the drawings in a particularorder, this should not be understood as requiring that such operationsbe performed in the particular order shown or in sequential order, orthat all illustrated operations be performed, to achieve desirableresults. In certain circumstances, multitasking and parallel processingmay be advantageous. Moreover, the separation of various systemcomponents in the embodiments described above should not be understoodas requiring such separation in all embodiments, and it should beunderstood that the described program components and systems cangenerally be integrated together in a single software or hardwareproduct or packaged into multiple software or hardware products.

The term “algorithm” can refer to steps, methods, processes, schemes,procedures, operations, programs, guidelines, techniques, sequences,and/or a set of rules or instructions to achieve the results describedherein. For example, an algorithm can be a set of audio and/or videoprocessing instructions for a hardware and/or software video and/oraudio processor. The disclosed algorithms (e.g., such as in the examplefigures and functional modules) can be related to and/or tied to videoand/or audio, and can be generated, implemented, associated, and/oremployed in video-related and/or audio-related systems and/or anydevices, machines, hardware, and/or articles of manufacture for thetransformation, processing, compression, storage, transmission,reception, testing, playback, calibration, display, and/or anyimprovement, in any combination, for video data and/or audio data.

Enumerated Example Embodiments

Embodiments of the present invention may relate to one or more exampleembodiments enumerated below.

1. A audio/video (A/V) system comprising: an audio/video (A/V) componentconfigured to generate audio or video data; one or more processingdevices configured to implement: an audio or video processing engineconfigured to process the audio or video data to generate one or moredifferent domain representations of the audio or video data; and one ormore audio or video processing applications that are each configured toaccess one or more of the different domain representations of the audioor video data and to perform audio or video processing on the one ormore accessed domain representations of the audio or video data, whereineach of the one or more processing applications access and process thedomain representations independently of each other.

2. The A/V system of enumerated example embodiment 1, wherein the one ormore processing devices are further configured to download the one ormore applications from a server.

3. The A/V system of enumerated example embodiment 1, wherein the one ormore processing devices are further configured to present an interfacefor a user to select one or more of the applications for downloading.

4. The A/V system of enumerated example embodiment 1, wherein the one ormore processing devices are configured to present an interface to an A/Vuser of the A/V component, the interface being configured to allow theA/V user to control settings for the one or more audio or videoprocessing applications, wherein the interface comprises one or morepanels for each audio or video processing application, wherein the oneor more panels allow at least one of functions that comprises: a firstpanel to activate or de-active the application; a second panel toprovide a description of the application to the A/V user; and a thirdpanel to present the settings to the A/V user.

5. The A/V system of enumerated example embodiment 4, wherein each audioor video processing application comprises: a processing module tointeract with the audio or video processing engine; and application datafor the interface for presentation of control and descriptioninformation for the application on the one or more panels.

6. The A/V system of enumerated example embodiment 4, wherein theinterface is overlayed over at least an image of video content that isplaying or playable in a background.

7. The A/V system of enumerated example embodiment 1, wherein the A/Vsystem comprises a router coupled to the A/V component.

8. The A/V system of enumerated example embodiment 7, wherein the routerincludes one or more of the processing devices.

9. The A/V system of enumerated example embodiment 7, wherein a computeris coupled to the router and the computer includes one or more of theprocessing devices.

10. The A/V system of enumerated example embodiment 1, wherein the A/Vcomponent includes one or more of the processing devices.

11. The A/V system of enumerated example embodiment 1, wherein the A/Vcomponent comprises a video display, a digital video player, atelevision tuner, an audio-video receiver (AVR) system, a satellitereceiver, or a cable television box.

12. The A/V system of enumerated example embodiment 1, wherein thedomain representations comprise a frequency domain and a perceptualdomain.

13. A method comprising: executing an audio or video processing engineconfigured to process audio or video data to generate one or moredifferent domain representations of the audio or video data; andexecuting one or more audio or video processing applications configuredto access one or more of the different domain representations of theaudio or video data and to perform audio or video processing on the oneor more accessed domain representations of the audio or video data.

14. The method of enumerated example embodiment 13, further comprising:downloading one of the audio or video processing applications from anapplication developer using a user account, wherein each downloadableaudio or video processing application further comprises data for agraphical user interface (GUI) for presentation on an A/V component; andinstalling the downloaded audio or video processing application to beused with the engine.

15. The method of enumerated example embodiment 14, further comprising:using the GUI to receive a user input to adjust the performance of theA/V component; in response to the user input, adjusting the performanceof the A/V component; and presenting a representation of the adjustmentto the performance of the A/V component in the GUI.

16. The method of enumerated example embodiment 13, wherein the audio orvideo processing application comprises a processing module, wherein themethod further comprises sharing processing resources when two or moreprocessing modules are processed in a frequency domain with the engine,and wherein the sharing of processing resources comprises reuse ofprocesses with the engine.

17. The method of enumerated example embodiment 16, wherein theprocessing in the frequency domain utilizing one or more transformscomprising a Fast Fourier Transform (FFT), a hybrid Quadrature MirrorFilter (QMF) bank, a discrete cosine transform (DCT), a modifieddiscrete cosine transform (MDCT), a Quadrature Mirror Filter (QMF), apseudo-quadrature mirror filter (PQMF), or a modified FFTrepresentation.

18. The method of enumerated example embodiment 16, wherein theprocessing in the frequency domain utilizes a frequency domainrepresentation of a decoder, wherein the processing in the frequencydomain further utilizes a frequency-to-time domain transformation of thedecoder.

19. The method of enumerated example embodiment 13, wherein the audio orvideo processing comprises: a transformation of the audio or video datafrom a time domain to a frequency domain; processing with the engine thetransformed audio or video data with the two or more audio or videoprocessing applications having processing modules in the frequencydomain; and a transformation of the processed audio or video data fromthe frequency domain to the time domain.

20. The method of enumerated example embodiment 19, wherein at least oneof the processing modules is configured for processing in the timedomain and in the frequency domain.

21. The method of enumerated example embodiment 13, further comprisingadjusting the performance of an A/V component by providing functionalityfor the A/V component in addition to the functionality of the A/Vcomponent at the time of manufacture, wherein the A/V componentcomprises a video display, a digital video player, a television tuner,an audio-video receiver (AVR) system, a satellite receiver, or a cabletelevision box.

22. The method of enumerated example embodiment 13, further comprisingadjusting an A/V component in regards to one or more factors, whereinthe one or more factors comprises a setting of the A/V component, ausage history of the A/V component, a configuration of the A/Vcomponent, a resource sharing requirement for the A/V component, aperformance requirement for the A/V component, an amount of processingresources, a level of quality of the A/V component, a type of content tobe played on the A/V system, or a number of processing modules toprocess.

23. A audio/video (A/V) system comprising: one or more processingdevices; one or more storage devices storing instructions that, whenexecuted by the one or more processing devices, cause the one or moreprocessing devices to implement: one or more audio or video processingapplications for the A/V system, wherein each of the applicationscomprises a processing module and data for a graphical user interface(GUI) for presentation on the A/V system, wherein each application isconfigured to adjust a performance or a setting of the A/V equipment; anaudio or video processing engine configured to interact with theprocessing modules for the applications, wherein the audio or videoprocessing engine is configured to share processing resources among twoor more of the processing modules.

24. The A/V system of enumerated example embodiment 23, wherein theaudio or video processing engine comprises an audio signal analysis(ASA) module for signal analysis of audio or video data, wherein the ASAmodule is further configured for sharing processing resources among theapplications.

25. The A/V system of enumerated example embodiment 23, furthercomprising metadata regarding the applications and the upgradableengine, wherein the metadata includes information regarding statisticsassociated with the engine, the applications, a user of the A/V system,characteristics of the A/V system, or characteristics of the user,wherein the engine is configured to manage the metadata.

26. The A/V system of enumerated example embodiment 25, wherein thecharacteristics of the A/V system comprises an age, a model, aperformance specification, an amount of usage, a type of content used, aperformance setting, an amount of processing resources, an input oroutput configuration, or a compatibility of the A/V equipment of the A/Vsystem.

27. The A/V system of enumerated example embodiment 25, wherein thecharacteristics of the user comprises an age of the user, a habit of theuser, a number of downloaded applications from the user, a type ofdownloaded applications from the user, or data from a profile of theuser based on a user profile or a user account.

28. The A/V system of enumerated example embodiment 25, wherein theupgradable engine is configured to use at least one of the applicationswith the metadata for enhancing a quality of a sound or an image for theA/V system over the quality of the sound or the image when used withoutthe application.

29. The A/V system of enumerated example embodiment 25, wherein the GUIcomprises data to present: one or more buttons for selecting orde-selecting of the application; a description of a purpose or afunction of the application; settings for configuring the A/V system;and a meter reading to present a measurement of a unit related to anaudio or video quality.

30. The A/V system of enumerated example embodiment 29, wherein the GUIcomprises data for each application to conform to a similar layout ordesign format, and wherein the processing modules share a commonapplication programming interface (API).

31. The A/V system of enumerated example embodiment 25, wherein each ofthe processing modules for each application comprises A/V data, signalanalysis modules, functional modules, and application programminginterface (API) information.

32. The A/V system of enumerated example embodiment 23, wherein theapplications comprise downloadable applications, and wherein the A/Vsystem further comprises: a sound sensor coupled to the A/V system todetect sound conditions around the A/V system; and a light sensorcoupled to the A/V system to detect light conditions around the A/Vsystem, and wherein the upgradable engine is configured to managedownloaded applications and adjust the performance or the setting of theA/V equipment based on the light and sound conditions.

33. The A/V system of enumerated example embodiment 32, furthercomprising a user account that comprises information for the A/V user,the A/V system, and the downloaded and downloadable applications,wherein the GUI is configured to manage the information for the useraccount with the A/V user and an application developer, wherein the A/Vsystem is configured to send statistics to the application developerover an Internet connection regarding the upgradable engine, thedownloaded applications, the A/V user, characteristics of the A/Vsystem, or characteristics of the A/V user.

34. The A/V system of enumerated example embodiment 32, wherein the A/Vsystem is configured to use data for the light and sound conditions todownload the downloadable applications and adjust the performance or thesetting of the A/V equipment.

35. The A/V system of enumerated example embodiment 32, furthercomprising a light and sound profile for the light and sound conditionsof the A/V equipment, wherein the light and sound profile is stored inone of the storage devices.

36. The A/V system of enumerated example embodiment 32, furthercomprising a biometric profile of the A/V user, wherein the A/V systemis configured to further adjust the performance or the setting of theA/V equipment based on the biometric profile of the A/V user, whereinthe biometric profile of the A/V user comprises at least a hearingprofile of the A/V user.

37. A method comprising: accessing a plurality of processing modules fora plurality of downloadable applications, wherein each downloadableapplication comprises at least one processing module and data for agraphical user interface (GUI), and wherein each processing module isconfigured to interact with an upgradable engine to adjust a performanceor a setting of an audio and video (A/V) equipment; and arranging anorder of two or more of the processing modules in a processing chain toshare processing resources, to reduce a processing requirement of theA/V equipment, or to enhance a level of performance of the A/Vequipment.

38. The method of enumerated example embodiment 37, wherein thearranging of the order of the two or more processing modules comprisesusing metadata to control the processing order.

39. The method of enumerated example embodiment 38, wherein the metadatarelates to a processing requirement or a level of performance.

40. The method of enumerated example embodiment 37, wherein the order ofthe processing modules comprises an order in which the processingmodules are processed with the upgradable engine, wherein the processingorder of the processing modules is dynamically adjustable based on oneor more factors.

41. The method of enumerated example embodiment 40, wherein the one ormore factors comprises a type, an age, a performance specification, or acondition of the A/V equipment, an input configuration or outputconfiguration on the A/V equipment, an amount of available processingresources, a number of processing modules to process, a type ofprocessing module, user requirements, a level of a quality of the A/Vequipment, a type of content to be played by the A/V equipment, aprocessing module to add to the processing chain, user input,information from a user profile, a usage history of the A/V equipment, apredefined processing order for a processing chain, or informationdownloaded from an application developer.

42. The method of enumerated example embodiment 37, wherein thearranging the order of two or more of the processing modules is basedupon a predefined processing order for a configuration of the A/Vequipment, wherein the predefined processing order is downloaded from anapplication developer.

43. The method of enumerated example embodiment 37, wherein thearranging the order of two or more of the processing modules comprises:assigning each of the processing modules to a level of a hierarchy of aprocessing chain; for each level of the hierarchy, evaluating aprocessing cost or a processing resource requirement to determine if theprocessing cost or the processing resource requirement is lower if theprocessing module in that level is rearranged into another level of thehierarchy; and if the processing cost or the processing resourcerequirement is lower if the processing module is positioned in the otherlevel of the hierarchy, then rearranging the order of the hierarchy toposition the processing module in the level that produces the lowerprocessing cost.

44. A audio/video (A/V) system comprising: downloadable applications foran A/V system, wherein each of the downloadable applications comprises aprocessing module and data for a graphical user interface (GUI) forpresentation on the A/V system, wherein each downloadable application isconfigured to adjust a performance or a setting of the A/V equipment; anupgradable engine configured to interact with the processing modules forthe downloadable applications, wherein the upgradable engine isconfigured to share processing resources in the A/V system for theprocessing modules, and wherein the upgradable engine is configured tomanage downloaded applications and adjust the performance or the settingof the A/V equipment based on one or more factors.

45. The A/V system of enumerated example embodiment 44, furthercomprising a user account that comprises information for the A/V user,the A/V system, and the downloaded and downloadable applications,wherein the GUI is configured to manage the information for the useraccount with the A/V user and an application developer, wherein the A/Vsystem is configured to send statistics to the application developerover an Internet connection regarding the upgradable engine, thedownloaded applications, the A/V user, characteristics of the A/Vsystem, or characteristics of the A/V user.

46. The A/V system of enumerated example embodiment 44, wherein the oneor more factors comprise a type of A/V equipment, an input configurationof the A/V equipment, an output configuration of the A/V equipment, aspecification of the A/V equipment, a level of quality of the A/Vequipment, or a usage history of the A/V equipment.

47. The A/V system of enumerated example embodiment 44, wherein the oneor more factors comprise an amount of processing power available for theA/V system, a number of applications for processing, a type ofapplication for processing, or a type of application available fordownloading.

48. The A/V system of enumerated example embodiment 44, wherein the oneor more factors comprise a type of A/V content to be played on the A/Vsystem, a user preference, or a user input.

49. The A/V system of enumerated example embodiment 44, wherein the oneor more factors comprise an age of the A/V equipment or a level ofdegradation of performance of the A/V equipment over time.

50. The A/V system of enumerated example embodiment 49, wherein at leastone of the applications is configured to correct for the level ofdegradation of performance of the A/V equipment.

51. The A/V system of enumerated example embodiment 44, furthercomprising a biometric profile of the A/V user, wherein the A/V systemis configured to further adjust the performance or the setting of theA/V equipment based on the biometric profile of the A/V user, whereinthe biometric profile of the A/V user comprises at least a hearingprofile of the A/V user.

52. A method for audio and video (A/V) equipment, the method comprising:sending a processing module for at least one of a plurality ofdownloadable applications from an application developer over an Internetconnection to A/V equipment for an A/V user, wherein each downloadableapplication comprises at least one processing module, and wherein eachdownloadable application is configured to interact with an upgradableengine to adjust a performance or a setting of the A/V equipment;sending statistics from the A/V equipment to the application developerover the Internet connection, the statistics comprising information forthe upgradable engine, the downloaded applications, the A/V user,characteristics of the A/V equipment, or characteristics, habits, ordemographics of the A/V user; forwarding at least some of thosestatistics from the application developer to a content provider or amanufacturer of the A/V equipment; and transmitting fee informationbetween the application developer and the content provider or betweenthe application developer and the manufacturer of the A/V equipment.

53. The method of enumerated example embodiment 52, further comprisingprocessing the processing module with the upgradable engine, wherein theprocessing comprises sharing processing resources for two or moreprocessing modules when the two or more processing modules are used tointeract with the upgradable engine; and adjusting the performance ofA/V equipment using the upgradable engine and the processing module.

54. The method of enumerated example embodiment 52, wherein sending thefee information comprises information for making arrangements forsending a fee from the application developer to the content provider.

55. The method of enumerated example embodiment 52, further comprisingsending an advertisement that promotes the applications of theapplication developer to the A/V equipment for the A/V user, wherein theadvertisement is configured for presentation on the A/V equipment.

56. The method of enumerated example embodiment 55, wherein when A/Vcontent is purchased from the content provider by the A/V user, theadvertisement is sent with A/V content from the content provider.

57. The method of enumerated example embodiment 52, wherein: sending theprocessing module comprises sending the processing module for at leastone of the plurality of downloadable applications from a first computerassociated with the application developer over the Internet connectionto A/V equipment for the A/V user, sending the statistics comprisessending the statistics from the A/V equipment to the first computerassociated with the application developer over the Internet connection,forwarding at least some of those statistics comprises forwarding atleast some of those statistics from the first computer associated withthe application developer to a second computer associated with thecontent provider or a third computer associated with the manufacturer ofthe A/V equipment, and transmitting the fee information comprisestransmitting the fee information between the first computer associatedwith the application developer and the second computer associated withthe content provider or between the first computer associated with theapplication developer and the third computer associated with themanufacturer of the A/V equipment.

58. The method of enumerated example embodiment 57, further comprising:forwarding information from the second computer associated with thecontent provider to the first computer associated with the applicationdeveloper regarding a type of content, target audiences for A/V content,or market information; determining at least one processing module fromthe first computer associated with the application developer to send tothe A/V equipment for the A/V user based on the information from thesecond computer associated with the content provider; and sending the atleast one processing module over the Internet connection from the firstcomputer associated with the application developer to the A/V equipmentof the A/V user based on the information from the second computerassociated with the content provider.

59. The method of enumerated example embodiment 58, wherein the contentprovider associates the A/V content with an advertisement for thedownloadable applications and promotes the downloadable applications tothe A/V user along with the A/V content that the content providerprovides or develops for the A/V user.

60. The method of enumerated example embodiment 57, further comprisingsending the fee information from the first computer associated with theapplication developer to the third computer associated with themanufacturer of the A/V equipment, wherein sending the fee informationcomprises information for making arrangements for sending a fee from theapplication developer to the manufacturer of the A/V equipment.

61. The method of enumerated example embodiment 57, further comprising:forwarding information from the third computer associated with themanufacturer of the A/V equipment to the first computer associated withthe application developer, the forwarded information comprising data,specification, and statistical information for the A/V equipment;determining at least one processing module from the applicationdeveloper to send to the A/V equipment for the A/V user based on theinformation from the manufacturer of the A/V equipment; and sending theat least one processing module over the Internet connection from thefirst computer associated with the application developer to the A/Vequipment for A/V user based on the information from the third computerassociated with the manufacturer of the A/V equipment.

62. The method of enumerated example embodiment 57, further comprisingsending additional statistics related to the A/V user to the firstcomputer associated with the application developer over the Internetconnection, the statistics comprising user biometric information, userratings, a user profile, a viewing or listening schedule of the A/Vuser, or a usage of downloaded applications.

63. The method of enumerated example embodiment 62, further comprisingsending A/V content from the second computer associated with the contentprovider to the A/V equipment for the A/V user.

The techniques and systems described herein can be combined with and/ortied to other multimedia applications, such as graphics, text, andrelated data, as well as biometric and environmental data. One or moreembodiments of the various types of formulations presented in thisdisclosure can take into account various display, processing, audioplayback, and/or distortion characteristics. In some aspects, the typeand order of processing can be partially or wholly decided based on anycombination of system complexity, channels, and distortion metrics.Various embodiments herein can apply to H.264, AVC, and any other videoand image coding methods, and related audio. The concepts herein canalso be extended to and applied in multi-dimensional video, such as 3-Dvideo. Particular embodiments of the disclosure have been described,other embodiments are within the scope of the following claims.

1. An audio/video (AV) system including AV equipment, the AV systemfurther comprising: one or more processing devices; and one or morestorage devices storing instructions that, when executed by the one ormore processing devices, cause the one or more processing devices tooperate with: a plurality of individually downloadable audio processingapplications for the AV system, wherein each of the applicationscomprises a processing module and data for a graphical user interfacefor presentation on the AV system, wherein each application isconfigured to adjust a performance or a setting of the AV equipment; andan audio processing engine configured to interact with each of theprocessing modules of the downloadable audio processing applications,wherein the audio processing engine comprises an audio signal analysismodule for signal analysis of audio data to identify perceptuallyrelevant auditory scene elements of the audio data, and wherein theaudio signal analysis module is used as a shared resource between atleast two of the downloadable audio processing applications in that theaudio signal analysis module provides information about the perceptuallyrelevant auditory scene elements that is utilized by the at least twodownloadable audio processing applications.
 2. The AV system of claim 1,wherein each of the processing modules is configured to: retrieve atleast one audio signal representation from the audio processing engine,modify the at least one audio signal representation, and return resultsof the modified audio signal representation back to the engine.
 3. TheAV system of claim 1, wherein the perceptually relevant auditory sceneelements comprise elements of the audio data for which level changes areinappropriate for an audio processing application.
 4. The AV system ofclaim 3, wherein the perceptually relevant auditory scene elements aresustained musical notes with decays.
 5. The AV system of claim 1,further comprising metadata associated with the applications and theaudio processing engine, wherein the metadata includes at least one ofstatistical information regarding the audio processing engine,statistical information regarding the plurality of audio processingapplications, statistical information regarding a user of the AV system,information regarding characteristics of the AV system, or informationregarding characteristics of the user, and wherein the audio processingengine is configured to manage the metadata.
 6. The AV system of claim5, wherein the characteristics of the AV system comprise an age of theAV equipment, a model of the AV equipment, a performance specificationof the AV equipment, an amount of usage of the AV equipment, a type ofcontent used in the AV equipment, a performance setting of the AVequipment, an amount of available processing resources in the AV system,an input or output configuration of the AV equipment, or a compatibilityof the AV equipment of the AV system.
 7. The AV system of claim 5,wherein the characteristics of the user comprise an age of the user, arecorded habit of a user's use of the AV system, a number of audioprocessing applications selected by the user for downloading, a type ofaudio processing applications downloaded by the user, or data from aprofile of the user based on a user profile or a user account.
 8. The AVsystem of claim 5, wherein the audio processing engine is configured touse at least one of the audio processing applications with the metadatafor enhancing a quality of a sound performance for the AV systemrelative to a quality of the sound performance when used without theapplication.
 9. The AV system of claim 5, wherein the graphical userinterface is configured to interact with the audio processingapplications to present: one or more selectors for selecting orde-selecting an audio processing application; a description of a purposeor a function of an audio processing application; settings forconfiguring the AV system; and a meter reading to present a measurementthat signifies an audio quality or a video quality, wherein thegraphical user interface comprises data for each audio processingapplication to conform to a similar display layout or common displaydesign format for the audio processing applications, and wherein theprocessing modules share a common application programming interface. 10.The AV system of claim 1, wherein the AV system further comprises: asound sensor coupled to the AV system to detect sound conditions aroundthe AV system; and a light sensor coupled to the AV system to detectlight conditions around the AV system, and wherein the audio processingengine is configured to manage downloaded audio processing applicationsand adjust the performance or the setting of the AV equipment based onthe detected light and sound conditions.
 11. The AV system of claim 10,further comprising a user account that comprises information for the anAV user, the AV system, and the applications, wherein the graphical userinterface is configured to manage the information for the user accountwith the AV user and an application developer, and wherein the AV systemis configured to communicate statistics with the application developerover an Internet connection regarding the audio processing engine, thedownloaded applications, the AV user, characteristics of the AV system,or characteristics of the AV user.
 12. The AV system of claim 10,further comprising a light and sound profile for the detected light andsound conditions of the AV equipment, wherein the light and soundprofile is stored in a storage device, and wherein the AV system isconfigured to use data for the detected light and sound conditions toprovide guidance for a selection of the downloadable audio processingapplications and to adjust the performance or the setting of the AVequipment.
 13. The AV system of claim 10, further comprising a hearingprofile of a user of the AV equipment, wherein the AV system isconfigured to further adjust the performance or the setting of the AVequipment based on the hearing profile of the user of the AV equipment.14. A method for an audio/video (AV) system comprising: accessing aplurality of individually downloadable audio processing applications foran AV system comprising an AV equipment, wherein each downloadable audioprocessing application comprises a processing module and data for agraphical user interface for presentation on the AV system, wherein thedownloadable audio processing applications are configured to adjust aperformance or a setting of the AV equipment; processing, via anupgradable audio processing engine, data associated with the pluralityof downloadable audio processing applications, wherein the upgradableaudio processing engine is configured to interact with each of theprocessing modules of the downloadable audio processing applications;managing the downloadable audio processing applications with theupgradable audio processing engine; and adjusting, via the upgradableaudio processing engine, the performance or the setting of the AVequipment based on one or more factors, wherein the upgradeable audioprocessing engine utilizes an audio signal analysis module for signalanalysis of audio data to identify perceptually relevant auditory sceneelements of the audio data, and wherein the audio signal analysis moduleis used as a shared resource between at least two of the downloadableaudio applications in that the audio signal analysis module providesinformation about the perceptually relevant auditory scene elements thatis utilized by the at least two downloadable audio processingapplications.
 15. The method of claim 14, wherein each of the processingmodules performs operations to: retrieve at least one AV signalrepresentation from the upgradeable audio processing engine, modify theat least one AV signal representation, and return results of themodified AV signal representation back to the upgradeable audioprocessing engine.
 16. The method of claim 14, wherein the perceptuallyrelevant auditory scene elements comprise elements of the audio data forwhich level changes are inappropriate for a selected audio processingapplication.
 17. The method of claim 14, further comprising accessing auser account that comprises information for the an AV user, the AVsystem, and the audio processing applications, managing, via thegraphical user interface, the information for the user account with theAV user and an application developer associated with the audioprocessing application, communicating, via the AV system, statistics tothe application developer over an Internet connection regarding at leastone of the upgradable audio processing engine, the downloaded audioprocessing applications, the AV user, characteristics of the AV system,or characteristics of the AV user.
 18. The method of claim 14, whereinthe one or more factors comprise a type of AV equipment, an inputconfiguration of the AV equipment, an output configuration of the AVequipment, a specification of the AV equipment, a level of quality ofthe AV equipment, or a usage history of the AV equipment.
 19. The methodof claim 14, wherein the one or more factors comprise an amount ofprocessing power available for the AV system, a number of audioprocessing applications for processing, a type of audio processingapplication for processing, or a type of audio processing applicationavailable for downloading.
 20. The method of claim 14, wherein the oneor more factors comprise a type of AV content to be played on the AVsystem, a user preference, or a user input value into the AV equipment.21. The method of claim 14, wherein the one or more factors comprise anage of the AV equipment with respect to a manufacturing date of the AVequipment.
 22. The method of claim 14, further comprising: accessing ahearing profile of the an AV user that models hearing abilities of theAV user; and adjusting the performance or the setting of the AVequipment based on the hearing profile and based on the processing ofthe data performed with the upgradable engine.
 23. (canceled)
 24. Atleast one machine-readable storage device tangibly embodying at leastone computer program, the at least one program comprising instructionsthat when executed by at least one processor cause the at least oneprocessor to perform operations comprising: accessing a plurality ofindividually downloadable audio processing applications for an AV systemcomprising an AV equipment, wherein each downloadable audio processingapplication comprises a processing module and data for a graphical userinterface for presentation on the AV system, wherein the downloadableaudio processing applications are configured to adjust a performance ora setting of the AV equipment; processing, via an upgradable audioprocessing engine, data associated with the plurality downloadable audioprocessing applications, wherein the upgradable audio processing engineis configured to interact with each of the processing modules of thedownloadable audio processing applications; managing the downloadableaudio processing applications with the upgradable audio processingengine; and adjusting, via the upgradable audio processing engine, theperformance or the setting of the AV equipment based on one or morefactors, wherein the upgradeable audio processing engine utilizes anaudio signal analysis module for signal analysis of audio data toidentify perceptually relevant auditory scene elements of the audiodata, and wherein the audio signal analysis module is used as a sharedresource between at least two of the downloadable audio applications inthat the audio signal analysis module provides information about theperceptually relevant auditory scene elements that is utilized by the atleast two downloadable audio processing applications.
 25. A systemcomprising: at least one computer; and at least one storage mediumcoupled to the at least one computer having instructions stored thereonwhich, when executed by the at least one computer, causes the at leastone computer to perform operations comprising: accessing a plurality ofindividually downloadable audio processing applications for an AV systemcomprising an AV equipment, wherein each downloadable audio processingapplication comprises a processing module and data for a graphical userinterface for presentation on the AV system, wherein the downloadableaudio processing applications are configured to adjust a performance ora setting of the AV equipment; processing, via an upgradable audioprocessing engine, data associated with the plurality of downloadableaudio processing applications, wherein the upgradable audio processingengine is configured to interact with each of the processing modules ofthe downloadable audio processing applications; managing thedownloadable audio processing applications with the upgradable audioprocessing engine; and adjusting, via the upgradable audio processingengine, the performance or the setting of the AV equipment based on oneor more factors, wherein the upgradeable audio processing engineutilizes an audio signal analysis module for signal analysis of audiodata to identify perceptually relevant auditory scene elements of theaudio data, and wherein the audio signal analysis module is used as ashared resource between at least two of the downloadable audioapplications in that the audio signal analysis module providesinformation about the perceptually relevant auditory scene elements thatis utilized by the at least two downloadable audio processingapplications.
 26. The AV system of claim 10, further comprising abiometric profile of an AV user of the AV equipment, wherein the AVsystem is configured to further adjust the performance or the setting ofthe AV equipment based on the biometric profile of the AV user.
 27. TheAV system of claim 26, wherein the biometric profile of the AV usercomprises at least a recorded audio profile of the AV user with respectto at least the sound conditions recorded around the AV equipment. 28.The AV system of claim 26, wherein the biometric profile of the AV usercomprises at least a hearing profile that is specific to the AV user.29. The AV system of claim 26, wherein the biometric profile of the AVuser comprises at least a predetermined hearing profile of the AV userat least based on information for an age of the AV user with respect toinformation for predetermined hearing profiles of AV users for aplurality of ages.
 30. The method of claim 14, wherein at least one ofthe factors comprises a level of degradation of a performance of the AVequipment over a time period, and the method further comprisingutilizing at least one of the audio processing applications to correctfor the level of degradation of performance of the AV equipment.